Jun 02 15:06:31.916115 ip-10-0-130-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 15:06:31.916129 ip-10-0-130-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 15:06:31.916138 ip-10-0-130-221 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 15:06:31.916481 ip-10-0-130-221 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 15:06:41.987385 ip-10-0-130-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 15:06:41.987403 ip-10-0-130-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b8a65ed72f8b45b68a860ab212418302 -- Jun 02 15:09:13.898448 ip-10-0-130-221 systemd[1]: Starting Kubernetes Kubelet... Jun 02 15:09:14.324722 ip-10-0-130-221 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:09:14.324722 ip-10-0-130-221 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 15:09:14.324722 ip-10-0-130-221 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:09:14.324722 ip-10-0-130-221 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 15:09:14.324722 ip-10-0-130-221 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:09:14.326322 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.326227 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 15:09:14.330907 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330886 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:14.330907 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330904 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:14.330907 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330909 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:14.330907 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330913 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330918 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330923 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330926 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330930 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330934 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330939 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330945 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330949 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330953 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330957 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330962 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330966 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330969 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330973 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330977 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330982 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330986 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330990 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:14.331151 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330994 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.330998 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331002 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331006 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331010 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331014 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331017 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331021 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331025 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331030 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331034 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331038 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331043 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331048 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331053 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331057 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331062 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331066 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331072 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331077 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:14.331945 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331082 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331087 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331092 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331097 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331103 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331107 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331111 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331115 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331119 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331123 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331127 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331131 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331136 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331140 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331145 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331149 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331153 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331157 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331161 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331166 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:14.332657 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331186 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331190 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331194 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331198 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331204 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331209 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331213 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331218 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331222 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331228 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331232 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331237 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331241 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331245 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331249 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331253 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331257 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331261 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331265 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331270 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:14.333179 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331274 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331279 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331283 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331288 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331881 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331889 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331893 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331897 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331901 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331905 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331910 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331913 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331918 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331922 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331926 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331930 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331939 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331943 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331948 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331952 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:14.333672 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331956 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331960 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331964 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331970 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331975 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331979 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331984 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331989 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331993 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.331997 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332001 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332005 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332010 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332014 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332018 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332023 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332027 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332033 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332037 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332042 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:14.334533 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332046 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332050 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332058 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332063 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332068 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332073 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332077 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332082 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332086 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332096 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332100 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332105 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332109 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332114 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332118 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332122 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332126 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332131 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332136 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332140 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:14.335333 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332144 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332149 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332153 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332158 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332162 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332185 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332190 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332194 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332198 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332202 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332208 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332212 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332215 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332220 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332224 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332228 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332232 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332236 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332240 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332244 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:14.335828 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332248 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332252 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332257 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332261 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332266 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332270 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332274 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332278 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332282 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.332286 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333746 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333763 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333773 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333779 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333786 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333791 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333798 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333805 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333811 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333816 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333822 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 15:09:14.336439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333827 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333832 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333837 2575 flags.go:64] FLAG: --cgroup-root="" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333841 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333847 2575 flags.go:64] FLAG: --client-ca-file="" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333851 2575 flags.go:64] FLAG: --cloud-config="" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333856 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333861 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333869 2575 flags.go:64] FLAG: --cluster-domain="" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333874 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333879 2575 flags.go:64] FLAG: --config-dir="" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333884 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333889 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333896 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333902 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333908 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333913 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333918 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333922 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333928 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333933 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333938 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333944 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333949 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333954 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 15:09:14.337192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333966 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333972 2575 flags.go:64] FLAG: --enable-server="true" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333976 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333983 2575 flags.go:64] FLAG: --event-burst="100" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333988 2575 flags.go:64] FLAG: --event-qps="50" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333993 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.333998 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334002 2575 flags.go:64] FLAG: --eviction-hard="" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334008 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334013 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334018 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334024 2575 flags.go:64] FLAG: --eviction-soft="" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334028 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334032 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334037 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334042 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334046 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334051 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334056 2575 flags.go:64] FLAG: --feature-gates="" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334063 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334068 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334073 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334081 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334086 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334090 2575 flags.go:64] FLAG: --help="false" Jun 02 15:09:14.337849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334095 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334101 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334106 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334111 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334117 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334123 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334127 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334132 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334138 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334143 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334147 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334153 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334158 2575 flags.go:64] FLAG: --kube-reserved="" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334163 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334181 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334187 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334192 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334196 2575 flags.go:64] FLAG: --lock-file="" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334201 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334206 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334211 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334220 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334225 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334230 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 15:09:14.338541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334234 2575 flags.go:64] FLAG: --logging-format="text" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334239 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334244 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334249 2575 flags.go:64] FLAG: --manifest-url="" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334254 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334261 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334267 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334274 2575 flags.go:64] FLAG: --max-pods="110" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334279 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334283 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334288 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334293 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334298 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334303 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334308 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334319 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334323 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334328 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334333 2575 flags.go:64] FLAG: --pod-cidr="" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334338 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334347 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334352 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334356 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334361 2575 flags.go:64] FLAG: --port="10250" Jun 02 15:09:14.339216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334366 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334370 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0484bd581e2f93487" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334376 2575 flags.go:64] FLAG: --qos-reserved="" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334381 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334385 2575 flags.go:64] FLAG: --register-node="true" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334390 2575 flags.go:64] FLAG: --register-schedulable="true" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334395 2575 flags.go:64] FLAG: --register-with-taints="" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334401 2575 flags.go:64] FLAG: --registry-burst="10" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334405 2575 flags.go:64] FLAG: --registry-qps="5" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334410 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334415 2575 flags.go:64] FLAG: --reserved-memory="" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334421 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334426 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334431 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334436 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334441 2575 flags.go:64] FLAG: --runonce="false" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334446 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334451 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334456 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334461 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334465 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334470 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334475 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334480 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334485 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334489 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 15:09:14.339799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334494 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334499 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334504 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334509 2575 flags.go:64] FLAG: --system-cgroups="" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334514 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334522 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334527 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334531 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334538 2575 flags.go:64] FLAG: --tls-min-version="" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334542 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334547 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334551 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334556 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334560 2575 flags.go:64] FLAG: --v="2" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334567 2575 flags.go:64] FLAG: --version="false" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334573 2575 flags.go:64] FLAG: --vmodule="" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334583 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.334588 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334737 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334745 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334750 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334755 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334760 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:14.340472 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334765 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334770 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334774 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334779 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334783 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334787 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334792 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334796 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334800 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334804 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334808 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334813 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334817 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334822 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334826 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334830 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334834 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334839 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334843 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334847 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:14.341029 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334853 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334859 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334864 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334868 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334872 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334879 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334883 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334887 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334891 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334895 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334899 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334903 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334908 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334913 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334917 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334921 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334925 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334929 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334933 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334938 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:14.341595 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334942 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334946 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334950 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334955 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334962 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334967 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334972 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334977 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334981 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334985 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334989 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334993 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.334998 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335002 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335006 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335011 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335015 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335020 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335025 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:14.342111 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335029 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335034 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335038 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335042 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335046 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335051 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335056 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335060 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335064 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335069 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335073 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335077 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335081 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335085 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335090 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335094 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335100 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335104 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335108 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335112 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:14.342612 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335116 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:14.343100 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.335120 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:14.343100 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.335884 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:09:14.343751 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.343730 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 15:09:14.343789 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.343752 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343797 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343802 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343805 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343808 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343812 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343815 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343818 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343820 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:14.343820 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343823 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343826 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343829 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343831 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343834 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343842 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343845 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343848 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343850 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343853 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343856 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343864 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343867 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343870 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343872 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343875 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343877 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343880 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343882 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343885 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:14.344036 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343887 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343890 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343893 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343895 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343898 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343900 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343902 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343905 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343908 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343910 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343913 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343915 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343917 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343920 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343923 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343926 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343929 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343932 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343940 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343943 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:14.344578 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343945 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343948 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343950 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343953 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343955 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343958 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343960 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343962 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343965 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343968 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343970 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343973 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343975 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343979 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343983 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343986 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343988 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343991 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343993 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:14.345070 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343996 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.343998 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344001 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344004 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344006 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344009 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344011 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344015 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344017 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344020 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344023 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344026 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344034 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344036 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344039 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344043 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344048 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344051 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:14.345565 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344053 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.344059 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344203 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344208 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344211 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344214 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344216 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344219 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344222 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344224 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344227 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344229 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344232 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344235 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344237 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344240 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:09:14.346106 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344242 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344245 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344247 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344250 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344252 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344255 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344258 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344262 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344266 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344268 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344271 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344280 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344283 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344286 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344289 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344291 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344294 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344296 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344299 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:09:14.346563 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344301 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344304 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344306 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344309 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344311 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344314 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344316 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344319 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344321 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344324 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344326 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344329 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344331 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344334 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344336 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344339 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344341 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344343 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344346 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344349 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:09:14.347022 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344352 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344354 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344356 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344359 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344362 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344371 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344374 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344376 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344378 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344381 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344383 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344386 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344389 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344391 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344394 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344396 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344398 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344401 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344403 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344406 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:09:14.347520 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344408 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344410 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344413 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344417 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344420 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344423 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344426 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344429 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344431 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344434 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344436 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344439 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:14.344441 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.344446 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:09:14.348051 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.345385 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 15:09:14.348422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.347787 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 15:09:14.348627 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.348616 2575 server.go:1019] "Starting client certificate rotation" Jun 02 15:09:14.348743 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.348730 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:09:14.348772 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.348760 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:09:14.372203 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.372183 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:09:14.376560 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.376538 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:09:14.390000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.389984 2575 log.go:25] "Validated CRI v1 runtime API" Jun 02 15:09:14.397612 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.397598 2575 log.go:25] "Validated CRI v1 image API" Jun 02 15:09:14.398984 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.398968 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 15:09:14.402606 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.402586 2575 fs.go:135] Filesystem UUIDs: map[2ef2277b-0fa2-441d-b8c1-1b563a07e490:/dev/nvme0n1p4 56e52382-db15-4007-a642-77e1e56a3e7c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 02 15:09:14.402680 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.402605 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 15:09:14.407076 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.407058 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:09:14.407380 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.407285 2575 manager.go:217] Machine: {Timestamp:2026-06-02 15:09:14.406722321 +0000 UTC m=+0.395352165 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101072 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bf6a71feaeb2bae5edb26973e0bc9 SystemUUID:ec2bf6a7-1fea-eb2b-ae5e-db26973e0bc9 BootID:b8a65ed7-2f8b-45b6-8a86-0ab212418302 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:0d:59:79:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:0d:59:79:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:da:2e:2a:77:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 15:09:14.407985 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.407975 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 15:09:14.408059 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.408049 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 15:09:14.409948 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.409923 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 15:09:14.410091 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.409951 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 15:09:14.410137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.410102 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 15:09:14.410137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.410109 2575 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 15:09:14.410137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.410116 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:09:14.410866 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.410856 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:09:14.412035 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.412026 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:09:14.412151 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.412143 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 15:09:14.414285 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.414276 2575 kubelet.go:491] "Attempting to sync node with API server" Jun 02 15:09:14.414324 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.414309 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 15:09:14.414324 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.414322 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 15:09:14.414378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.414332 2575 kubelet.go:397] "Adding apiserver pod source" Jun 02 15:09:14.414378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.414340 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 15:09:14.415757 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.415742 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:09:14.415806 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.415773 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:09:14.419005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.418990 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 15:09:14.421281 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.421268 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 15:09:14.423677 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423656 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 15:09:14.423677 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423686 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423697 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423706 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423719 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423735 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423745 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423753 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423765 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423774 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423787 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 15:09:14.423810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.423796 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 15:09:14.424751 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.424734 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 15:09:14.424841 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.424831 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 15:09:14.428068 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.428054 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 15:09:14.428134 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.428121 2575 server.go:1295] "Started kubelet" Jun 02 15:09:14.428234 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.428187 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 15:09:14.428684 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.428640 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 15:09:14.428751 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.428709 2575 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 15:09:14.428958 ip-10-0-130-221 systemd[1]: Started Kubernetes Kubelet. Jun 02 15:09:14.432054 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.432033 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 15:09:14.433014 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.433000 2575 server.go:317] "Adding debug handlers to kubelet server" Jun 02 15:09:14.435399 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.435378 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 15:09:14.435479 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.435459 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 15:09:14.435535 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.435496 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 15:09:14.439385 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.439360 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 15:09:14.442885 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.442867 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 15:09:14.442971 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.442879 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 15:09:14.442971 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.442932 2575 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 15:09:14.442971 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.442945 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 15:09:14.443124 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.442973 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 15:09:14.443124 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.443022 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 02 15:09:14.443124 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.443030 2575 reconciler.go:26] "Reconciler: start to sync state" Jun 02 15:09:14.443634 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.443618 2575 factory.go:55] Registering systemd factory Jun 02 15:09:14.443634 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.443634 2575 factory.go:223] Registration of the systemd container factory successfully Jun 02 15:09:14.443911 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.443891 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:14.444010 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.443933 2575 factory.go:153] Registering CRI-O factory Jun 02 15:09:14.444010 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.443988 2575 factory.go:223] Registration of the crio container factory successfully Jun 02 15:09:14.444117 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.444038 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 15:09:14.444117 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.444057 2575 factory.go:103] Registering Raw factory Jun 02 15:09:14.444117 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.444070 2575 manager.go:1196] Started watching for new ooms in manager Jun 02 15:09:14.444469 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.444453 2575 manager.go:319] Starting recovery of all containers Jun 02 15:09:14.446635 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.446612 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 15:09:14.446878 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.446854 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 15:09:14.447710 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.446608 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-221.ec2.internal.18b54c26263047ce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-221.ec2.internal,UID:ip-10-0-130-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-221.ec2.internal,},FirstTimestamp:2026-06-02 15:09:14.428065742 +0000 UTC m=+0.416695585,LastTimestamp:2026-06-02 15:09:14.428065742 +0000 UTC m=+0.416695585,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-221.ec2.internal,}" Jun 02 15:09:14.454855 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.454723 2575 manager.go:324] Recovery completed Jun 02 15:09:14.459007 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.458995 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:14.460837 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.460811 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:14.460912 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.460851 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:14.460912 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.460868 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:14.461677 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.461654 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 15:09:14.461677 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.461671 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 15:09:14.461783 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.461688 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:09:14.465196 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.465112 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-221.ec2.internal.18b54c2628244ebc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-221.ec2.internal,UID:ip-10-0-130-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-221.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-221.ec2.internal,},FirstTimestamp:2026-06-02 15:09:14.460835516 +0000 UTC m=+0.449465365,LastTimestamp:2026-06-02 15:09:14.460835516 +0000 UTC m=+0.449465365,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-221.ec2.internal,}" Jun 02 15:09:14.465377 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.465361 2575 policy_none.go:49] "None policy: Start" Jun 02 15:09:14.465434 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.465387 2575 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 15:09:14.465434 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.465405 2575 state_mem.go:35] "Initializing new in-memory state store" Jun 02 15:09:14.476058 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.475988 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-221.ec2.internal.18b54c262824a811 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-221.ec2.internal,UID:ip-10-0-130-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-221.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-221.ec2.internal,},FirstTimestamp:2026-06-02 15:09:14.460858385 +0000 UTC m=+0.449488230,LastTimestamp:2026-06-02 15:09:14.460858385 +0000 UTC m=+0.449488230,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-221.ec2.internal,}" Jun 02 15:09:14.484163 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.484145 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-88nz8" Jun 02 15:09:14.485583 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.485501 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-221.ec2.internal.18b54c262824e36a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-221.ec2.internal,UID:ip-10-0-130-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-221.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-221.ec2.internal,},FirstTimestamp:2026-06-02 15:09:14.460873578 +0000 UTC m=+0.449503423,LastTimestamp:2026-06-02 15:09:14.460873578 +0000 UTC m=+0.449503423,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-221.ec2.internal,}" Jun 02 15:09:14.490064 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.490047 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-88nz8" Jun 02 15:09:14.510723 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.510711 2575 manager.go:341] "Starting Device Plugin manager" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.510736 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.510745 2575 server.go:85] "Starting device plugin registration server" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.510936 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.510946 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.511057 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.511160 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.511184 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.511640 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 15:09:14.515021 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.511679 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:14.580457 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.580396 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 15:09:14.581554 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.581535 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 15:09:14.581639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.581561 2575 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 15:09:14.581639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.581579 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 15:09:14.581639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.581587 2575 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 15:09:14.581639 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.581621 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 15:09:14.584362 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.584345 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:14.611514 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.611488 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:14.612664 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.612650 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:14.612731 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.612676 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:14.612731 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.612687 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:14.612731 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.612707 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.620908 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.620894 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.620965 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.620913 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-221.ec2.internal\": node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:14.636956 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.636934 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:14.682581 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.682545 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal"] Jun 02 15:09:14.682674 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.682623 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:14.683416 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.683394 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:14.683497 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.683426 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:14.683497 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.683436 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:14.684592 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.684580 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:14.684746 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.684732 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.684793 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.684760 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:14.685233 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.685214 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:14.685310 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.685214 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:14.685310 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.685271 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:14.685310 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.685284 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:14.685310 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.685246 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:14.685445 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.685330 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:14.686425 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.686410 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.686483 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.686435 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:09:14.687041 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.687025 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:09:14.687098 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.687055 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:09:14.687098 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.687069 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:09:14.701683 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.701664 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-221.ec2.internal\" not found" node="ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.705471 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.705457 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-221.ec2.internal\" not found" node="ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.737280 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.737261 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:14.744557 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.744530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97cde45faab90e45162c67d900e0ac54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal\" (UID: \"97cde45faab90e45162c67d900e0ac54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.744636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.744568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cde45faab90e45162c67d900e0ac54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal\" (UID: \"97cde45faab90e45162c67d900e0ac54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.744636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.744591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/927300f7c57ab2a0de8ae3d4c341220d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-221.ec2.internal\" (UID: \"927300f7c57ab2a0de8ae3d4c341220d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.838042 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.837988 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:14.845312 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.845295 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/927300f7c57ab2a0de8ae3d4c341220d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-221.ec2.internal\" (UID: \"927300f7c57ab2a0de8ae3d4c341220d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.845373 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.845319 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97cde45faab90e45162c67d900e0ac54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal\" (UID: \"97cde45faab90e45162c67d900e0ac54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.845373 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.845336 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cde45faab90e45162c67d900e0ac54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal\" (UID: \"97cde45faab90e45162c67d900e0ac54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.845471 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.845373 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cde45faab90e45162c67d900e0ac54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal\" (UID: \"97cde45faab90e45162c67d900e0ac54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.845471 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.845393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/927300f7c57ab2a0de8ae3d4c341220d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-221.ec2.internal\" (UID: \"927300f7c57ab2a0de8ae3d4c341220d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.845471 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:14.845422 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97cde45faab90e45162c67d900e0ac54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal\" (UID: \"97cde45faab90e45162c67d900e0ac54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:14.938684 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:14.938659 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.005143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.005115 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:15.010143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.010126 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" Jun 02 15:09:15.039289 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.039269 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.139806 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.139745 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.240216 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.240193 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.318099 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.318076 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:15.340556 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.340537 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.348892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.348872 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 15:09:15.348993 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.348976 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:09:15.349044 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.348975 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:09:15.440713 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.440696 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.443413 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.443389 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 15:09:15.446900 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.446882 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:15.454689 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.454672 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:09:15.493558 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.493526 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 15:04:14 +0000 UTC" deadline="2028-02-03 15:04:48.812918748 +0000 UTC" Jun 02 15:09:15.493558 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.493555 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14663h55m33.319366452s" Jun 02 15:09:15.510270 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.510245 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l6twl" Jun 02 15:09:15.516459 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.516440 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l6twl" Jun 02 15:09:15.530909 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:15.530877 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927300f7c57ab2a0de8ae3d4c341220d.slice/crio-2818011c83a248e6d945457e4603e041aef7f85e78661782d62e4cade247f18c WatchSource:0}: Error finding container 2818011c83a248e6d945457e4603e041aef7f85e78661782d62e4cade247f18c: Status 404 returned error can't find the container with id 2818011c83a248e6d945457e4603e041aef7f85e78661782d62e4cade247f18c Jun 02 15:09:15.531145 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:15.531094 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cde45faab90e45162c67d900e0ac54.slice/crio-b331433ba93853cdaa6485dcfd9db9ded134e0fe54752e1361c7d2a3ed89b39f WatchSource:0}: Error finding container b331433ba93853cdaa6485dcfd9db9ded134e0fe54752e1361c7d2a3ed89b39f: Status 404 returned error can't find the container with id b331433ba93853cdaa6485dcfd9db9ded134e0fe54752e1361c7d2a3ed89b39f Jun 02 15:09:15.534638 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.534624 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:09:15.541578 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.541279 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.585725 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.585677 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" event={"ID":"927300f7c57ab2a0de8ae3d4c341220d","Type":"ContainerStarted","Data":"2818011c83a248e6d945457e4603e041aef7f85e78661782d62e4cade247f18c"} Jun 02 15:09:15.586615 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.586595 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" event={"ID":"97cde45faab90e45162c67d900e0ac54","Type":"ContainerStarted","Data":"b331433ba93853cdaa6485dcfd9db9ded134e0fe54752e1361c7d2a3ed89b39f"} Jun 02 15:09:15.641754 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.641720 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.742268 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.742204 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.842623 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:15.842600 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-221.ec2.internal\" not found" Jun 02 15:09:15.852738 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.852719 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:15.943655 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.943633 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" Jun 02 15:09:15.954686 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.954667 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:09:15.955521 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.955509 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" Jun 02 15:09:15.967665 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:15.967648 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:09:16.415856 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.415519 2575 apiserver.go:52] "Watching apiserver" Jun 02 15:09:16.422904 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.422881 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:16.424688 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.424666 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 15:09:16.425154 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.425090 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal","openshift-multus/multus-additional-cni-plugins-94tzf","openshift-multus/multus-zrw2p","openshift-multus/network-metrics-daemon-9gfmq","openshift-network-diagnostics/network-check-target-zvz4n","openshift-network-operator/iptables-alerter-cb69z","kube-system/konnectivity-agent-j7tzj","openshift-cluster-node-tuning-operator/tuned-2p8m5","openshift-dns/node-resolver-ldbwc","openshift-image-registry/node-ca-r8cmf","openshift-ovn-kubernetes/ovnkube-node-q62qb","kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal"] Jun 02 15:09:16.426612 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.426588 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.428001 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.427807 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.429610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.428979 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.429610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.429429 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhbwg\"" Jun 02 15:09:16.429610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.429444 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 15:09:16.429610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.429518 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 15:09:16.429610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.429584 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:09:16.430773 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.430749 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9kcp5\"" Jun 02 15:09:16.430773 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.430763 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 15:09:16.430942 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.430924 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 15:09:16.431003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.430944 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 15:09:16.431211 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.431195 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 15:09:16.431289 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.431240 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 15:09:16.431899 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.431833 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:16.431981 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.431898 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:16.432045 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.431990 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 15:09:16.432225 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.432187 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m2g2t\"" Jun 02 15:09:16.433261 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.433238 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:16.433342 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.433315 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:16.434998 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.434614 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.434998 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.434956 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.436234 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.436115 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.437147 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.437130 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dttdp\"" Jun 02 15:09:16.437286 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.437270 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 15:09:16.437469 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.437450 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 15:09:16.437614 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.437596 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 15:09:16.437807 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.437552 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 15:09:16.437807 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.437505 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8n9g6\"" Jun 02 15:09:16.438302 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.438285 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 15:09:16.438638 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.438617 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.438717 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.438694 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l7rt4\"" Jun 02 15:09:16.438773 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.438727 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 15:09:16.439915 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.439895 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.443688 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.443663 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:09:16.443862 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.443840 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 15:09:16.443948 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.443932 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 15:09:16.444042 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444028 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 15:09:16.444488 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444220 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.444902 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444663 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 15:09:16.444902 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444683 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 15:09:16.444902 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444694 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 15:09:16.444902 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444750 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v67zk\"" Jun 02 15:09:16.444902 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444683 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 15:09:16.444902 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.444754 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-245nj\"" Jun 02 15:09:16.445143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.445055 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 15:09:16.452582 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhn9\" (UniqueName: \"kubernetes.io/projected/0956e794-2ecc-4bed-bf5e-0b98b72fc529-kube-api-access-plhn9\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.452582 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-run-ovn-kubernetes\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.452582 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a972111b-d207-4714-a8c6-e6aca1cb97c6-tmp\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.452786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452599 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abea5766-591c-41b6-82a7-20a67699acc6-tmp-dir\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.452786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.452786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-sys-fs\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.452786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-kubelet\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.452786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452733 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-host-slash\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.452786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-var-lib-kubelet\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.452786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-kubelet\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-multus-certs\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452829 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-device-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-ovn\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-node-log\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovnkube-config\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.452918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-conf-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dgr\" (UniqueName: \"kubernetes.io/projected/a972111b-d207-4714-a8c6-e6aca1cb97c6-kube-api-access-72dgr\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-run\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-systemd\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.453143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-hostroot\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-run-netns\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxc7m\" (UniqueName: \"kubernetes.io/projected/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-kube-api-access-cxc7m\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-host\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-log-socket\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysctl-d\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-os-release\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.453666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.453303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-k8s-cni-cncf-io\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.454862 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.454695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8db04ac7-0181-46e1-9c72-27797418f9bd-konnectivity-ca\") pod \"konnectivity-agent-j7tzj\" (UID: \"8db04ac7-0181-46e1-9c72-27797418f9bd\") " pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.454862 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.454736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-systemd-units\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.454862 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.454765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-cni-bin\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.454862 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.454792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-env-overrides\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.455058 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.454952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8bd\" (UniqueName: \"kubernetes.io/projected/ecb76c3f-dea8-491e-85e5-68452ce93e85-kube-api-access-fz8bd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.455058 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.454988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-os-release\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.455058 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455017 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:16.455058 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vlz2\" (UniqueName: \"kubernetes.io/projected/15b804b1-e2ae-45e1-bd11-c73958c829d7-kube-api-access-5vlz2\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.455251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.455251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qmbv\" (UniqueName: \"kubernetes.io/projected/abea5766-591c-41b6-82a7-20a67699acc6-kube-api-access-2qmbv\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.455251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-kubernetes\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.455251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455155 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-cnibin\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.455251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4e2b5c8-c339-40a2-95a1-05360fc37db3-cni-binary-copy\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.455251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-netns\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-modprobe-d\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cni-binary-copy\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-cni-bin\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-sys\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-lib-modules\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-tuned\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cnibin\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6kf\" (UniqueName: \"kubernetes.io/projected/75b890ed-1d05-439e-984d-61d35ed04b3b-kube-api-access-wr6kf\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovnkube-script-lib\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.455545 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455544 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysctl-conf\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-cni-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-slash\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-etc-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovn-node-metrics-cert\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-iptables-alerter-script\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-cni-netd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abea5766-591c-41b6-82a7-20a67699acc6-hosts-file\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-socket-dir-parent\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-daemon-config\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqt5\" (UniqueName: \"kubernetes.io/projected/b4e2b5c8-c339-40a2-95a1-05360fc37db3-kube-api-access-wpqt5\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0956e794-2ecc-4bed-bf5e-0b98b72fc529-serviceca\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x2kh\" (UniqueName: \"kubernetes.io/projected/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-kube-api-access-2x2kh\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.455986 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-etc-kubernetes\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.456005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-systemd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456032 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-system-cni-dir\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-system-cni-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-cni-multus\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-socket-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8db04ac7-0181-46e1-9c72-27797418f9bd-agent-certs\") pod \"konnectivity-agent-j7tzj\" (UID: \"8db04ac7-0181-46e1-9c72-27797418f9bd\") " pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456215 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysconfig\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-registration-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-var-lib-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.456610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.456312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0956e794-2ecc-4bed-bf5e-0b98b72fc529-host\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.457361 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.457324 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 15:09:16.457450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.457344 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mq47m\"" Jun 02 15:09:16.457450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.457392 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 15:09:16.457450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.457393 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 15:09:16.517784 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.517745 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:04:15 +0000 UTC" deadline="2027-12-17 22:37:36.050554221 +0000 UTC" Jun 02 15:09:16.517784 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.517783 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13519h28m19.532775459s" Jun 02 15:09:16.544284 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.544259 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 15:09:16.556509 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556478 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-run-ovn-kubernetes\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.556640 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556516 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a972111b-d207-4714-a8c6-e6aca1cb97c6-tmp\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.556640 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556533 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abea5766-591c-41b6-82a7-20a67699acc6-tmp-dir\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.556640 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556558 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.556640 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556592 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-run-ovn-kubernetes\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.556640 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556610 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-sys-fs\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.556640 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556637 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-kubelet\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556660 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-host-slash\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556700 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-var-lib-kubelet\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-sys-fs\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556725 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-kubelet\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-kubelet\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-host-slash\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556751 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-multus-certs\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556776 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-device-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-var-lib-kubelet\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556795 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-kubelet\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556811 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-ovn\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556832 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-device-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.556847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556838 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-node-log\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556870 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-ovn\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556875 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-node-log\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-multus-certs\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556892 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovnkube-config\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abea5766-591c-41b6-82a7-20a67699acc6-tmp-dir\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556920 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-conf-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556921 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556949 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72dgr\" (UniqueName: \"kubernetes.io/projected/a972111b-d207-4714-a8c6-e6aca1cb97c6-kube-api-access-72dgr\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.556995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-conf-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557028 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-run\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557080 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-systemd\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557106 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557127 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-hostroot\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-run\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557152 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-run-netns\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557198 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxc7m\" (UniqueName: \"kubernetes.io/projected/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-kube-api-access-cxc7m\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557215 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-hostroot\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.557378 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-host\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557257 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557266 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557267 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-run-netns\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557294 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-log-socket\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557326 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-host\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557316 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysctl-d\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557349 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557369 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-os-release\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557415 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-k8s-cni-cncf-io\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557442 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8db04ac7-0181-46e1-9c72-27797418f9bd-konnectivity-ca\") pod \"konnectivity-agent-j7tzj\" (UID: \"8db04ac7-0181-46e1-9c72-27797418f9bd\") " pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557465 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-systemd-units\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysctl-d\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557494 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-cni-bin\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557495 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovnkube-config\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557517 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-env-overrides\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-k8s-cni-cncf-io\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-log-socket\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557563 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8bd\" (UniqueName: \"kubernetes.io/projected/ecb76c3f-dea8-491e-85e5-68452ce93e85-kube-api-access-fz8bd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557641 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-os-release\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557659 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-os-release\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557670 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557689 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-systemd\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557697 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vlz2\" (UniqueName: \"kubernetes.io/projected/15b804b1-e2ae-45e1-bd11-c73958c829d7-kube-api-access-5vlz2\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557752 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557785 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qmbv\" (UniqueName: \"kubernetes.io/projected/abea5766-591c-41b6-82a7-20a67699acc6-kube-api-access-2qmbv\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557817 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-kubernetes\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557825 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-cni-bin\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557844 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-cnibin\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557935 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-env-overrides\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.557981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-systemd-units\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558007 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4e2b5c8-c339-40a2-95a1-05360fc37db3-cni-binary-copy\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-kubernetes\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.558041 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:16.558892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558065 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-netns\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-cnibin\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558139 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8db04ac7-0181-46e1-9c72-27797418f9bd-konnectivity-ca\") pod \"konnectivity-agent-j7tzj\" (UID: \"8db04ac7-0181-46e1-9c72-27797418f9bd\") " pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558205 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-run-netns\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558211 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-modprobe-d\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558215 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-os-release\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.558715 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:17.058685127 +0000 UTC m=+3.047314981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.558886 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cni-binary-copy\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-modprobe-d\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559147 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4e2b5c8-c339-40a2-95a1-05360fc37db3-cni-binary-copy\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cni-binary-copy\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559658 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-cni-bin\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559705 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.559730 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559731 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-sys\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559736 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-cni-bin\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559759 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-lib-modules\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559831 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-tuned\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559850 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-sys\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559874 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cnibin\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559910 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6kf\" (UniqueName: \"kubernetes.io/projected/75b890ed-1d05-439e-984d-61d35ed04b3b-kube-api-access-wr6kf\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559945 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovnkube-script-lib\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559975 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysctl-conf\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.559983 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-lib-modules\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560003 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-cni-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560080 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-cni-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560124 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-slash\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560158 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-etc-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560213 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovn-node-metrics-cert\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-iptables-alerter-script\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560271 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:16.560400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560314 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-cni-netd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560346 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abea5766-591c-41b6-82a7-20a67699acc6-hosts-file\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560374 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-socket-dir-parent\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560396 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-daemon-config\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560424 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqt5\" (UniqueName: \"kubernetes.io/projected/b4e2b5c8-c339-40a2-95a1-05360fc37db3-kube-api-access-wpqt5\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0956e794-2ecc-4bed-bf5e-0b98b72fc529-serviceca\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560485 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2x2kh\" (UniqueName: \"kubernetes.io/projected/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-kube-api-access-2x2kh\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560514 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-etc-kubernetes\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560541 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-systemd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-system-cni-dir\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560602 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560634 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-system-cni-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560667 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-cni-multus\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560695 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-socket-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-cnibin\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560726 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8db04ac7-0181-46e1-9c72-27797418f9bd-agent-certs\") pod \"konnectivity-agent-j7tzj\" (UID: \"8db04ac7-0181-46e1-9c72-27797418f9bd\") " pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560760 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysconfig\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.561128 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560798 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-registration-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560827 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560854 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-var-lib-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560885 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0956e794-2ecc-4bed-bf5e-0b98b72fc529-host\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560887 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysctl-conf\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-etc-kubernetes\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-run-systemd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560967 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plhn9\" (UniqueName: \"kubernetes.io/projected/0956e794-2ecc-4bed-bf5e-0b98b72fc529-kube-api-access-plhn9\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.560986 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-system-cni-dir\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.561124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-socket-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.561312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-sysconfig\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.561771 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovnkube-script-lib\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.561847 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-registration-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.561946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.561942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.562601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.562019 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-var-lib-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.562601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.562078 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0956e794-2ecc-4bed-bf5e-0b98b72fc529-host\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.562601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.562161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-socket-dir-parent\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.562601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.562245 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-slash\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.562601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.562295 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-etc-openvswitch\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.562824 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.562773 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a972111b-d207-4714-a8c6-e6aca1cb97c6-tmp\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.563702 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.563676 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-iptables-alerter-script\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.563886 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.563817 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.563886 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.563866 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-host-var-lib-cni-multus\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.563996 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.563922 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abea5766-591c-41b6-82a7-20a67699acc6-hosts-file\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.564120 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.564094 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0956e794-2ecc-4bed-bf5e-0b98b72fc529-serviceca\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.564194 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.564162 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecb76c3f-dea8-491e-85e5-68452ce93e85-host-cni-netd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.564509 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.564484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8db04ac7-0181-46e1-9c72-27797418f9bd-agent-certs\") pod \"konnectivity-agent-j7tzj\" (UID: \"8db04ac7-0181-46e1-9c72-27797418f9bd\") " pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.564661 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.564638 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4e2b5c8-c339-40a2-95a1-05360fc37db3-multus-daemon-config\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.564725 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.564709 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15b804b1-e2ae-45e1-bd11-c73958c829d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.564943 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.564922 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4e2b5c8-c339-40a2-95a1-05360fc37db3-system-cni-dir\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.565801 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.565595 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a972111b-d207-4714-a8c6-e6aca1cb97c6-etc-tuned\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.566009 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.565988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecb76c3f-dea8-491e-85e5-68452ce93e85-ovn-node-metrics-cert\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.569102 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.568800 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:16.569102 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.568831 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:16.569102 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.568846 2575 projected.go:194] Error preparing data for projected volume kube-api-access-cggq9 for pod openshift-network-diagnostics/network-check-target-zvz4n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:16.569102 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:16.568919 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9 podName:66ea6704-b48a-4f59-8fe3-8e64ee4e99a1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:17.068902115 +0000 UTC m=+3.057531965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cggq9" (UniqueName: "kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9") pod "network-check-target-zvz4n" (UID: "66ea6704-b48a-4f59-8fe3-8e64ee4e99a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:16.571040 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.571017 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dgr\" (UniqueName: \"kubernetes.io/projected/a972111b-d207-4714-a8c6-e6aca1cb97c6-kube-api-access-72dgr\") pod \"tuned-2p8m5\" (UID: \"a972111b-d207-4714-a8c6-e6aca1cb97c6\") " pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.571122 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.571099 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6kf\" (UniqueName: \"kubernetes.io/projected/75b890ed-1d05-439e-984d-61d35ed04b3b-kube-api-access-wr6kf\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:16.571455 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.571434 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vlz2\" (UniqueName: \"kubernetes.io/projected/15b804b1-e2ae-45e1-bd11-c73958c829d7-kube-api-access-5vlz2\") pod \"aws-ebs-csi-driver-node-kvvlk\" (UID: \"15b804b1-e2ae-45e1-bd11-c73958c829d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.572334 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.572310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qmbv\" (UniqueName: \"kubernetes.io/projected/abea5766-591c-41b6-82a7-20a67699acc6-kube-api-access-2qmbv\") pod \"node-resolver-ldbwc\" (UID: \"abea5766-591c-41b6-82a7-20a67699acc6\") " pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.572420 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.572353 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxc7m\" (UniqueName: \"kubernetes.io/projected/cb738951-85a9-4ba6-a1a6-fbc7d1364b1d-kube-api-access-cxc7m\") pod \"iptables-alerter-cb69z\" (UID: \"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d\") " pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.573240 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.573217 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x2kh\" (UniqueName: \"kubernetes.io/projected/ac61bc8b-025e-4ee3-8a31-41bcdee6da26-kube-api-access-2x2kh\") pod \"multus-additional-cni-plugins-94tzf\" (UID: \"ac61bc8b-025e-4ee3-8a31-41bcdee6da26\") " pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.573685 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.573664 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqt5\" (UniqueName: \"kubernetes.io/projected/b4e2b5c8-c339-40a2-95a1-05360fc37db3-kube-api-access-wpqt5\") pod \"multus-zrw2p\" (UID: \"b4e2b5c8-c339-40a2-95a1-05360fc37db3\") " pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.573974 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.573947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhn9\" (UniqueName: \"kubernetes.io/projected/0956e794-2ecc-4bed-bf5e-0b98b72fc529-kube-api-access-plhn9\") pod \"node-ca-r8cmf\" (UID: \"0956e794-2ecc-4bed-bf5e-0b98b72fc529\") " pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:16.574039 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.574016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8bd\" (UniqueName: \"kubernetes.io/projected/ecb76c3f-dea8-491e-85e5-68452ce93e85-kube-api-access-fz8bd\") pod \"ovnkube-node-q62qb\" (UID: \"ecb76c3f-dea8-491e-85e5-68452ce93e85\") " pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.744303 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.744222 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cb69z" Jun 02 15:09:16.750806 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.750782 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-94tzf" Jun 02 15:09:16.753509 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:16.753469 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb738951_85a9_4ba6_a1a6_fbc7d1364b1d.slice/crio-82b62b010aed4b1b311666a03a0b8822d35120c91f23c5f439dfc9ec8e9138a3 WatchSource:0}: Error finding container 82b62b010aed4b1b311666a03a0b8822d35120c91f23c5f439dfc9ec8e9138a3: Status 404 returned error can't find the container with id 82b62b010aed4b1b311666a03a0b8822d35120c91f23c5f439dfc9ec8e9138a3 Jun 02 15:09:16.759584 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:16.759553 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac61bc8b_025e_4ee3_8a31_41bcdee6da26.slice/crio-bfd702e3473d88ecde27efe8b1a4abc4b44019a9b68fb8234f39ab447a54925b WatchSource:0}: Error finding container bfd702e3473d88ecde27efe8b1a4abc4b44019a9b68fb8234f39ab447a54925b: Status 404 returned error can't find the container with id bfd702e3473d88ecde27efe8b1a4abc4b44019a9b68fb8234f39ab447a54925b Jun 02 15:09:16.760544 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.760509 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrw2p" Jun 02 15:09:16.766005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.765990 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" Jun 02 15:09:16.767279 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:16.767258 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e2b5c8_c339_40a2_95a1_05360fc37db3.slice/crio-8ee57a7a88f6d4aa2ab735d12211d2969f54a8c3b9cd50da11e75512b8306b8c WatchSource:0}: Error finding container 8ee57a7a88f6d4aa2ab735d12211d2969f54a8c3b9cd50da11e75512b8306b8c: Status 404 returned error can't find the container with id 8ee57a7a88f6d4aa2ab735d12211d2969f54a8c3b9cd50da11e75512b8306b8c Jun 02 15:09:16.773957 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.773936 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:16.781025 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.781003 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" Jun 02 15:09:16.788513 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.788494 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ldbwc" Jun 02 15:09:16.796075 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.796055 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:16.801627 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:16.801611 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8cmf" Jun 02 15:09:17.065435 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.065372 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:17.065552 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:17.065474 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:17.065552 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:17.065524 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:18.065510454 +0000 UTC m=+4.054140285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:17.166269 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.166235 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:17.166428 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:17.166382 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:17.166428 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:17.166402 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:17.166428 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:17.166414 2575 projected.go:194] Error preparing data for projected volume kube-api-access-cggq9 for pod openshift-network-diagnostics/network-check-target-zvz4n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:17.166563 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:17.166478 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9 podName:66ea6704-b48a-4f59-8fe3-8e64ee4e99a1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:18.166458246 +0000 UTC m=+4.155088102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cggq9" (UniqueName: "kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9") pod "network-check-target-zvz4n" (UID: "66ea6704-b48a-4f59-8fe3-8e64ee4e99a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:17.304186 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.304148 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:09:17.518530 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.518457 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:04:15 +0000 UTC" deadline="2028-02-21 10:55:05.313871632 +0000 UTC" Jun 02 15:09:17.518530 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.518493 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15091h45m47.795383076s" Jun 02 15:09:17.557687 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:17.557527 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b804b1_e2ae_45e1_bd11_c73958c829d7.slice/crio-653cbf0c843b813a4c09bb3774bb59243b3047661c009101018b453532608d24 WatchSource:0}: Error finding container 653cbf0c843b813a4c09bb3774bb59243b3047661c009101018b453532608d24: Status 404 returned error can't find the container with id 653cbf0c843b813a4c09bb3774bb59243b3047661c009101018b453532608d24 Jun 02 15:09:17.558943 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:17.558798 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda972111b_d207_4714_a8c6_e6aca1cb97c6.slice/crio-ab0541d21340d1b0c799c558d3b07443cdeb1a55f3c03b690dad66c47f7afacc WatchSource:0}: Error finding container ab0541d21340d1b0c799c558d3b07443cdeb1a55f3c03b690dad66c47f7afacc: Status 404 returned error can't find the container with id ab0541d21340d1b0c799c558d3b07443cdeb1a55f3c03b690dad66c47f7afacc Jun 02 15:09:17.561989 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:17.561956 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabea5766_591c_41b6_82a7_20a67699acc6.slice/crio-617e740924627bc586232c824544a08c7dcf63767d1bd8a735a976a7b5a5c562 WatchSource:0}: Error finding container 617e740924627bc586232c824544a08c7dcf63767d1bd8a735a976a7b5a5c562: Status 404 returned error can't find the container with id 617e740924627bc586232c824544a08c7dcf63767d1bd8a735a976a7b5a5c562 Jun 02 15:09:17.563620 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:17.563591 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0956e794_2ecc_4bed_bf5e_0b98b72fc529.slice/crio-4407fc7b353671435a4537171f764d1314aac931793f03fada174310e1e3f64b WatchSource:0}: Error finding container 4407fc7b353671435a4537171f764d1314aac931793f03fada174310e1e3f64b: Status 404 returned error can't find the container with id 4407fc7b353671435a4537171f764d1314aac931793f03fada174310e1e3f64b Jun 02 15:09:17.564201 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:09:17.564188 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db04ac7_0181_46e1_9c72_27797418f9bd.slice/crio-9f5544fa9fc0cec3ef93a8ae2fbb75074620466319045054b157b66dfa4dc005 WatchSource:0}: Error finding container 9f5544fa9fc0cec3ef93a8ae2fbb75074620466319045054b157b66dfa4dc005: Status 404 returned error can't find the container with id 9f5544fa9fc0cec3ef93a8ae2fbb75074620466319045054b157b66dfa4dc005 Jun 02 15:09:17.591733 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.591708 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"68929a3fa69847f1d0bc5a0231842aeb5ff5b6309e90c30d131a412c32092f40"} Jun 02 15:09:17.594598 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.594572 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8cmf" event={"ID":"0956e794-2ecc-4bed-bf5e-0b98b72fc529","Type":"ContainerStarted","Data":"4407fc7b353671435a4537171f764d1314aac931793f03fada174310e1e3f64b"} Jun 02 15:09:17.597838 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.597815 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ldbwc" event={"ID":"abea5766-591c-41b6-82a7-20a67699acc6","Type":"ContainerStarted","Data":"617e740924627bc586232c824544a08c7dcf63767d1bd8a735a976a7b5a5c562"} Jun 02 15:09:17.598836 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.598809 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerStarted","Data":"bfd702e3473d88ecde27efe8b1a4abc4b44019a9b68fb8234f39ab447a54925b"} Jun 02 15:09:17.599780 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.599761 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cb69z" event={"ID":"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d","Type":"ContainerStarted","Data":"82b62b010aed4b1b311666a03a0b8822d35120c91f23c5f439dfc9ec8e9138a3"} Jun 02 15:09:17.600656 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.600640 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j7tzj" event={"ID":"8db04ac7-0181-46e1-9c72-27797418f9bd","Type":"ContainerStarted","Data":"9f5544fa9fc0cec3ef93a8ae2fbb75074620466319045054b157b66dfa4dc005"} Jun 02 15:09:17.601482 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.601465 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" event={"ID":"a972111b-d207-4714-a8c6-e6aca1cb97c6","Type":"ContainerStarted","Data":"ab0541d21340d1b0c799c558d3b07443cdeb1a55f3c03b690dad66c47f7afacc"} Jun 02 15:09:17.602294 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.602276 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" event={"ID":"15b804b1-e2ae-45e1-bd11-c73958c829d7","Type":"ContainerStarted","Data":"653cbf0c843b813a4c09bb3774bb59243b3047661c009101018b453532608d24"} Jun 02 15:09:17.603047 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:17.603031 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrw2p" event={"ID":"b4e2b5c8-c339-40a2-95a1-05360fc37db3","Type":"ContainerStarted","Data":"8ee57a7a88f6d4aa2ab735d12211d2969f54a8c3b9cd50da11e75512b8306b8c"} Jun 02 15:09:18.075438 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.075400 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:18.075668 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.075567 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:18.075668 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.075633 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:20.075613097 +0000 UTC m=+6.064242944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:18.177409 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.176339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:18.177409 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.176563 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:18.177409 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.176584 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:18.177409 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.176673 2575 projected.go:194] Error preparing data for projected volume kube-api-access-cggq9 for pod openshift-network-diagnostics/network-check-target-zvz4n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:18.177409 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.176735 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9 podName:66ea6704-b48a-4f59-8fe3-8e64ee4e99a1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:20.176716451 +0000 UTC m=+6.165346304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cggq9" (UniqueName: "kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9") pod "network-check-target-zvz4n" (UID: "66ea6704-b48a-4f59-8fe3-8e64ee4e99a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:18.585326 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.584518 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:18.585326 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.584654 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:18.585326 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.585087 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:18.585326 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:18.585190 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:18.611600 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.611553 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" event={"ID":"927300f7c57ab2a0de8ae3d4c341220d","Type":"ContainerStarted","Data":"fcc3394612c6ce2647409ba13866f3182db0cb06e01599ec1e97aaa4514bfb6e"} Jun 02 15:09:18.620787 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.620746 2575 generic.go:358] "Generic (PLEG): container finished" podID="97cde45faab90e45162c67d900e0ac54" containerID="682c62b808db4fa809dbfbb10ce77b747c833d7a1053344a14bf5e28752ffe6d" exitCode=0 Jun 02 15:09:18.620787 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.620783 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" event={"ID":"97cde45faab90e45162c67d900e0ac54","Type":"ContainerDied","Data":"682c62b808db4fa809dbfbb10ce77b747c833d7a1053344a14bf5e28752ffe6d"} Jun 02 15:09:18.639984 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:18.639935 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-221.ec2.internal" podStartSLOduration=3.639919817 podStartE2EDuration="3.639919817s" podCreationTimestamp="2026-06-02 15:09:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:09:18.62609099 +0000 UTC m=+4.614720843" watchObservedRunningTime="2026-06-02 15:09:18.639919817 +0000 UTC m=+4.628549671" Jun 02 15:09:19.631063 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:19.631028 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" event={"ID":"97cde45faab90e45162c67d900e0ac54","Type":"ContainerStarted","Data":"fe48b9f78e11de261296284cb574da38e6799a131d3ebcd595e1fc20c63008a6"} Jun 02 15:09:20.095566 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.094188 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:20.095566 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.094322 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:20.095566 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.094382 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:24.094362453 +0000 UTC m=+10.082992286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:20.194852 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.194788 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:20.195022 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.194929 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:20.195022 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.194949 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:20.195022 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.194970 2575 projected.go:194] Error preparing data for projected volume kube-api-access-cggq9 for pod openshift-network-diagnostics/network-check-target-zvz4n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:20.195195 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.195024 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9 podName:66ea6704-b48a-4f59-8fe3-8e64ee4e99a1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:24.195006093 +0000 UTC m=+10.183635931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cggq9" (UniqueName: "kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9") pod "network-check-target-zvz4n" (UID: "66ea6704-b48a-4f59-8fe3-8e64ee4e99a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:20.509932 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.509602 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-221.ec2.internal" podStartSLOduration=5.509582663 podStartE2EDuration="5.509582663s" podCreationTimestamp="2026-06-02 15:09:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:09:19.646593253 +0000 UTC m=+5.635223107" watchObservedRunningTime="2026-06-02 15:09:20.509582663 +0000 UTC m=+6.498212512" Jun 02 15:09:20.510828 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.510805 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tzn79"] Jun 02 15:09:20.512701 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.512682 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.512795 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.512767 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:20.583054 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.583015 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:20.583226 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.583080 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:20.583226 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.583188 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:20.583599 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.583565 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:20.598518 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.598486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-dbus\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.598644 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.598546 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-kubelet-config\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.598644 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.598600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.699314 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.699276 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.699724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.699372 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-dbus\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.699724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.699416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-kubelet-config\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.699724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.699514 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-kubelet-config\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:20.699724 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.699653 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:20.699724 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:20.699714 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret podName:ccd6dfbf-ac8a-4657-839c-33555a71e2b9 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:21.199693836 +0000 UTC m=+7.188323669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret") pod "global-pull-secret-syncer-tzn79" (UID: "ccd6dfbf-ac8a-4657-839c-33555a71e2b9") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:20.700000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:20.699855 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-dbus\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:21.202269 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:21.202228 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:21.202506 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:21.202376 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:21.202506 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:21.202445 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret podName:ccd6dfbf-ac8a-4657-839c-33555a71e2b9 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:22.202428277 +0000 UTC m=+8.191058129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret") pod "global-pull-secret-syncer-tzn79" (UID: "ccd6dfbf-ac8a-4657-839c-33555a71e2b9") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:22.210632 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:22.210527 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:22.211063 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:22.210672 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:22.211063 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:22.210736 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret podName:ccd6dfbf-ac8a-4657-839c-33555a71e2b9 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:24.210716232 +0000 UTC m=+10.199346070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret") pod "global-pull-secret-syncer-tzn79" (UID: "ccd6dfbf-ac8a-4657-839c-33555a71e2b9") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:22.582763 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:22.582682 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:22.582920 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:22.582682 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:22.582920 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:22.582817 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:22.583033 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:22.582913 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:22.583033 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:22.582682 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:22.583033 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:22.583026 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:24.123704 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:24.123658 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:24.124115 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.123831 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:24.124115 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.123912 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:32.123888976 +0000 UTC m=+18.112518808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:24.224476 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:24.224436 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:24.224666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:24.224514 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:24.224666 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.224656 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:24.224772 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.224677 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:24.224772 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.224687 2575 projected.go:194] Error preparing data for projected volume kube-api-access-cggq9 for pod openshift-network-diagnostics/network-check-target-zvz4n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:24.224772 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.224743 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9 podName:66ea6704-b48a-4f59-8fe3-8e64ee4e99a1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:32.224723718 +0000 UTC m=+18.213353553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cggq9" (UniqueName: "kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9") pod "network-check-target-zvz4n" (UID: "66ea6704-b48a-4f59-8fe3-8e64ee4e99a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:24.225136 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.225043 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:24.225136 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.225117 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret podName:ccd6dfbf-ac8a-4657-839c-33555a71e2b9 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:28.225099679 +0000 UTC m=+14.213729513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret") pod "global-pull-secret-syncer-tzn79" (UID: "ccd6dfbf-ac8a-4657-839c-33555a71e2b9") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:24.583427 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:24.583348 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:24.583582 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.583468 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:24.583582 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:24.583530 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:24.583701 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.583608 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:24.583870 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:24.583848 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:24.583995 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:24.583971 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:26.583022 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:26.582621 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:26.583022 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:26.582744 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:26.583022 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:26.582791 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:26.583022 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:26.582841 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:26.583022 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:26.582932 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:26.583022 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:26.583028 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:27.645551 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.645310 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j7tzj" event={"ID":"8db04ac7-0181-46e1-9c72-27797418f9bd","Type":"ContainerStarted","Data":"8eee801b58b0112b56c00027a72de34c6ed982e11d887e559301c75912a768de"} Jun 02 15:09:27.646992 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.646960 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" event={"ID":"a972111b-d207-4714-a8c6-e6aca1cb97c6","Type":"ContainerStarted","Data":"05b9ca5a35c34b60d433baa75d01287302082e3fd5ebd704d90f35e1b45343f2"} Jun 02 15:09:27.648587 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.648522 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" event={"ID":"15b804b1-e2ae-45e1-bd11-c73958c829d7","Type":"ContainerStarted","Data":"682f5834c779b96c627b134f143a0fff97dbe9e22a017e81141aae55259ce7b4"} Jun 02 15:09:27.649880 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.649828 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8cmf" event={"ID":"0956e794-2ecc-4bed-bf5e-0b98b72fc529","Type":"ContainerStarted","Data":"a0d582f90845faadf80992fb5d1f1fdf52dc9efe5094260538aa3e40b18a1c74"} Jun 02 15:09:27.651199 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.651155 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ldbwc" event={"ID":"abea5766-591c-41b6-82a7-20a67699acc6","Type":"ContainerStarted","Data":"20d9a07e24044b39c068633f6474ec1c00e2e4d3c84531446761f25995c50eb5"} Jun 02 15:09:27.652643 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.652620 2575 generic.go:358] "Generic (PLEG): container finished" podID="ac61bc8b-025e-4ee3-8a31-41bcdee6da26" containerID="6b03b159cd73eba3c6e57d9b7f965a131070ffc5056fc590427cef3edbc15ef7" exitCode=0 Jun 02 15:09:27.652737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.652657 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerDied","Data":"6b03b159cd73eba3c6e57d9b7f965a131070ffc5056fc590427cef3edbc15ef7"} Jun 02 15:09:27.661052 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.661004 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j7tzj" podStartSLOduration=4.313316029 podStartE2EDuration="13.660988501s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:17.566528529 +0000 UTC m=+3.555158374" lastFinishedPulling="2026-06-02 15:09:26.914201002 +0000 UTC m=+12.902830846" observedRunningTime="2026-06-02 15:09:27.660393184 +0000 UTC m=+13.649023039" watchObservedRunningTime="2026-06-02 15:09:27.660988501 +0000 UTC m=+13.649618355" Jun 02 15:09:27.690159 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.690120 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ldbwc" podStartSLOduration=4.340916109 podStartE2EDuration="13.690109353s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:17.563794719 +0000 UTC m=+3.552424554" lastFinishedPulling="2026-06-02 15:09:26.912987935 +0000 UTC m=+12.901617798" observedRunningTime="2026-06-02 15:09:27.689520292 +0000 UTC m=+13.678150149" watchObservedRunningTime="2026-06-02 15:09:27.690109353 +0000 UTC m=+13.678739205" Jun 02 15:09:27.701797 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.701755 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r8cmf" podStartSLOduration=3.355004072 podStartE2EDuration="12.701741428s" podCreationTimestamp="2026-06-02 15:09:15 +0000 UTC" firstStartedPulling="2026-06-02 15:09:17.565642528 +0000 UTC m=+3.554272373" lastFinishedPulling="2026-06-02 15:09:26.912379883 +0000 UTC m=+12.901009729" observedRunningTime="2026-06-02 15:09:27.701429996 +0000 UTC m=+13.690059849" watchObservedRunningTime="2026-06-02 15:09:27.701741428 +0000 UTC m=+13.690371283" Jun 02 15:09:27.714613 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:27.714578 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2p8m5" podStartSLOduration=4.307254212 podStartE2EDuration="13.714568737s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:17.560707014 +0000 UTC m=+3.549336845" lastFinishedPulling="2026-06-02 15:09:26.968021524 +0000 UTC m=+12.956651370" observedRunningTime="2026-06-02 15:09:27.714409979 +0000 UTC m=+13.703039833" watchObservedRunningTime="2026-06-02 15:09:27.714568737 +0000 UTC m=+13.703198665" Jun 02 15:09:28.260700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.260674 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:28.260822 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:28.260807 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:28.260875 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:28.260862 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret podName:ccd6dfbf-ac8a-4657-839c-33555a71e2b9 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:36.260844488 +0000 UTC m=+22.249474318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret") pod "global-pull-secret-syncer-tzn79" (UID: "ccd6dfbf-ac8a-4657-839c-33555a71e2b9") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:28.312762 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.312742 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 15:09:28.518268 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.518118 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T15:09:28.312758229Z","UUID":"8ba4be3b-d70a-43d1-a4ba-375115474528","Handler":null,"Name":"","Endpoint":""} Jun 02 15:09:28.519895 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.519862 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 15:09:28.519895 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.519894 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 15:09:28.582357 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.582321 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:28.582522 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.582370 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:28.582522 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:28.582454 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:28.582622 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.582561 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:28.582695 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:28.582674 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:28.582811 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:28.582786 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:28.656145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.656108 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cb69z" event={"ID":"cb738951-85a9-4ba6-a1a6-fbc7d1364b1d","Type":"ContainerStarted","Data":"a9f1547ce6497f71c59ed67424c5d2da12d3e2852d78873e79d4f351fb016a3a"} Jun 02 15:09:28.658045 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:28.658007 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" event={"ID":"15b804b1-e2ae-45e1-bd11-c73958c829d7","Type":"ContainerStarted","Data":"620397b6c32c7d41b7e627bc38160024dd76167453bfad7bf08ff3fee3d31488"} Jun 02 15:09:29.323240 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:29.323210 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:29.323882 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:29.323861 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:29.336300 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:29.336258 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cb69z" podStartSLOduration=5.163905465 podStartE2EDuration="15.336241635s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:16.755698496 +0000 UTC m=+2.744328327" lastFinishedPulling="2026-06-02 15:09:26.928034665 +0000 UTC m=+12.916664497" observedRunningTime="2026-06-02 15:09:28.669573945 +0000 UTC m=+14.658203797" watchObservedRunningTime="2026-06-02 15:09:29.336241635 +0000 UTC m=+15.324871493" Jun 02 15:09:30.582027 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:30.581993 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:30.582636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:30.581993 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:30.582636 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:30.582109 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:30.582636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:30.582150 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:30.582636 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:30.582269 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:30.582636 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:30.582360 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:30.661285 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:30.661147 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:09:32.192929 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:32.192688 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:32.193341 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.192840 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:32.193341 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.193011 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:09:48.192991387 +0000 UTC m=+34.181621229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:32.294054 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:32.294010 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:32.294232 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.294202 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:32.294232 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.294224 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:32.294345 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.294237 2575 projected.go:194] Error preparing data for projected volume kube-api-access-cggq9 for pod openshift-network-diagnostics/network-check-target-zvz4n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:32.294345 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.294304 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9 podName:66ea6704-b48a-4f59-8fe3-8e64ee4e99a1 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:48.294282904 +0000 UTC m=+34.282912737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cggq9" (UniqueName: "kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9") pod "network-check-target-zvz4n" (UID: "66ea6704-b48a-4f59-8fe3-8e64ee4e99a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:32.582302 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:32.582186 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:32.582302 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:32.582240 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:32.582498 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.582327 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:32.582498 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.582365 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:32.582498 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:32.582378 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:32.582498 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:32.582482 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:34.582692 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:34.582651 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:34.583225 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:34.582752 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:34.583225 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:34.582806 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:34.583225 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:34.582861 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:34.583225 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:34.582902 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:34.583225 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:34.582965 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:36.326824 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:36.326770 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:36.327372 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:36.326960 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:36.327372 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:36.327041 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret podName:ccd6dfbf-ac8a-4657-839c-33555a71e2b9 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:52.327022226 +0000 UTC m=+38.315652057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret") pod "global-pull-secret-syncer-tzn79" (UID: "ccd6dfbf-ac8a-4657-839c-33555a71e2b9") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:36.582423 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:36.582337 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:36.582596 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:36.582337 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:36.582596 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:36.582475 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:36.582596 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:36.582345 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:36.582596 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:36.582521 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:36.582774 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:36.582640 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:38.582099 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:38.582054 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:38.582099 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:38.582093 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:38.582719 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:38.582121 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:38.582719 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:38.582227 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:38.582719 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:38.582280 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:38.582719 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:38.582337 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:38.993601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:38.993575 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:38.993747 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:38.993685 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:09:38.994313 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:38.994288 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j7tzj" Jun 02 15:09:39.677127 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.676907 2575 generic.go:358] "Generic (PLEG): container finished" podID="ac61bc8b-025e-4ee3-8a31-41bcdee6da26" containerID="47ea24f7685d5e047bb1f5fa01361b66de2e06b8074b829a331d08563dd8fbae" exitCode=0 Jun 02 15:09:39.677127 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.676993 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerDied","Data":"47ea24f7685d5e047bb1f5fa01361b66de2e06b8074b829a331d08563dd8fbae"} Jun 02 15:09:39.679026 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.679002 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" event={"ID":"15b804b1-e2ae-45e1-bd11-c73958c829d7","Type":"ContainerStarted","Data":"0d83ecf031c9fe3427eb72a122808f49cadc34303439c458024938583a93e125"} Jun 02 15:09:39.680240 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.680220 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrw2p" event={"ID":"b4e2b5c8-c339-40a2-95a1-05360fc37db3","Type":"ContainerStarted","Data":"ea87e42c934aa7ae5a1ecff82e7c60314723e0901f107e461fd9b48c2ff7a625"} Jun 02 15:09:39.682679 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.682660 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"eec3774881b27069fa70f82861897334979fe3035d54178e002eaeaad3adf559"} Jun 02 15:09:39.682757 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.682683 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"05da6e2b9394e46270ff8ddd4090dd04cc9e3c5afb72f21daa1e25a8d546120b"} Jun 02 15:09:39.682757 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.682692 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"606b93d7c71410250b7d003aa37d00995cfb7101039c6d60433b7e9e68f91193"} Jun 02 15:09:39.682757 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.682700 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"85c176fe74721439a3751a00f89837f140c90f2317c082b644846bf96cfcde3d"} Jun 02 15:09:39.682757 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.682709 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"d97e4382782114bd61dd03c75881ec2e1f374fbba31722aa7b0532b4c255a490"} Jun 02 15:09:39.682757 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.682719 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"0567c15036f17db97eae482b6eafe1e0b7007336adf3d09d70bbafd130a3acb6"} Jun 02 15:09:39.718277 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.718238 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zrw2p" podStartSLOduration=3.402111454 podStartE2EDuration="25.718227087s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:16.768572956 +0000 UTC m=+2.757202787" lastFinishedPulling="2026-06-02 15:09:39.084688575 +0000 UTC m=+25.073318420" observedRunningTime="2026-06-02 15:09:39.717975385 +0000 UTC m=+25.706605231" watchObservedRunningTime="2026-06-02 15:09:39.718227087 +0000 UTC m=+25.706856940" Jun 02 15:09:39.736927 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:39.736887 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvvlk" podStartSLOduration=4.256327661 podStartE2EDuration="25.736876638s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:17.559905984 +0000 UTC m=+3.548535834" lastFinishedPulling="2026-06-02 15:09:39.040454976 +0000 UTC m=+25.029084811" observedRunningTime="2026-06-02 15:09:39.734054478 +0000 UTC m=+25.722684332" watchObservedRunningTime="2026-06-02 15:09:39.736876638 +0000 UTC m=+25.725506490" Jun 02 15:09:40.581889 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:40.581862 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:40.582006 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:40.581864 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:40.582006 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:40.581948 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:40.582118 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:40.582049 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:40.582118 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:40.581873 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:40.582235 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:40.582154 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:40.685740 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:40.685716 2575 generic.go:358] "Generic (PLEG): container finished" podID="ac61bc8b-025e-4ee3-8a31-41bcdee6da26" containerID="015aa487d7bd87317614f1097b1a9294eca2d2febbac4276ee179f301b4dfb3d" exitCode=0 Jun 02 15:09:40.686026 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:40.685792 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerDied","Data":"015aa487d7bd87317614f1097b1a9294eca2d2febbac4276ee179f301b4dfb3d"} Jun 02 15:09:41.689584 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:41.689524 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"3b172e76f358541a57b7539d725fc68b23387122ca0e770658b3df38d998c719"} Jun 02 15:09:41.691468 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:41.691444 2575 generic.go:358] "Generic (PLEG): container finished" podID="ac61bc8b-025e-4ee3-8a31-41bcdee6da26" containerID="1a67697aef41715796b1e0db9c1d6b7a8e63a59023289c632562a9ff0410721c" exitCode=0 Jun 02 15:09:41.691574 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:41.691475 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerDied","Data":"1a67697aef41715796b1e0db9c1d6b7a8e63a59023289c632562a9ff0410721c"} Jun 02 15:09:42.582181 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:42.582132 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:42.582181 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:42.582141 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:42.582421 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:42.582142 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:42.582421 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:42.582269 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:42.582421 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:42.582323 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:42.582530 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:42.582428 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:44.582878 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:44.582684 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:44.583422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:44.582726 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:44.583422 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:44.583022 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:44.583422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:44.582754 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:44.583422 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:44.582946 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:44.583422 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:44.583111 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:44.698606 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:44.698571 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" event={"ID":"ecb76c3f-dea8-491e-85e5-68452ce93e85","Type":"ContainerStarted","Data":"5cff2620df5f4a59fc16c47766045425f0c839c275e6682301504c944c0819e5"} Jun 02 15:09:44.698891 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:44.698873 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:44.714752 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:44.714730 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:44.731712 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:44.731673 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" podStartSLOduration=9.258680048 podStartE2EDuration="30.731662846s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:17.567812112 +0000 UTC m=+3.556441952" lastFinishedPulling="2026-06-02 15:09:39.040794902 +0000 UTC m=+25.029424750" observedRunningTime="2026-06-02 15:09:44.731499784 +0000 UTC m=+30.720129649" watchObservedRunningTime="2026-06-02 15:09:44.731662846 +0000 UTC m=+30.720292696" Jun 02 15:09:45.700805 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.700778 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:45.700805 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.700805 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:45.715009 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.714987 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:09:45.751474 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.751445 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tzn79"] Jun 02 15:09:45.751600 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.751541 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:45.751671 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:45.751646 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:45.755113 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.754968 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9gfmq"] Jun 02 15:09:45.755113 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.755086 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:45.755284 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:45.755162 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:45.755604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.755586 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvz4n"] Jun 02 15:09:45.755675 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:45.755665 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:45.755747 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:45.755729 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:47.581916 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:47.581887 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:47.582356 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:47.581941 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:47.582356 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:47.581962 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:47.582356 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:47.582041 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:47.582356 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:47.582116 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:47.582356 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:47.582157 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:48.219518 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:48.219430 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:48.219660 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:48.219549 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:48.219660 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:48.219615 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:10:20.219596933 +0000 UTC m=+66.208226764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:09:48.320248 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:48.320216 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:48.320402 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:48.320386 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:09:48.320457 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:48.320409 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:09:48.320457 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:48.320423 2575 projected.go:194] Error preparing data for projected volume kube-api-access-cggq9 for pod openshift-network-diagnostics/network-check-target-zvz4n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:48.320568 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:48.320480 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9 podName:66ea6704-b48a-4f59-8fe3-8e64ee4e99a1 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:20.320461297 +0000 UTC m=+66.309091131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cggq9" (UniqueName: "kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9") pod "network-check-target-zvz4n" (UID: "66ea6704-b48a-4f59-8fe3-8e64ee4e99a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:09:49.581930 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:49.581894 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:49.581930 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:49.581917 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:49.581930 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:49.581894 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:49.582572 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:49.582021 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:49.582572 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:49.582115 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:49.582572 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:49.582155 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:50.710619 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:50.710434 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerStarted","Data":"17df464cc47f5c6119af679d9e35d253ae84ebab1badd7175968f1e5cfdeff3c"} Jun 02 15:09:51.582040 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.582012 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:51.582156 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.582017 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:51.582156 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:51.582102 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvz4n" podUID="66ea6704-b48a-4f59-8fe3-8e64ee4e99a1" Jun 02 15:09:51.582310 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:51.582202 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:09:51.582310 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.582017 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:51.582310 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:51.582281 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzn79" podUID="ccd6dfbf-ac8a-4657-839c-33555a71e2b9" Jun 02 15:09:51.714603 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.714531 2575 generic.go:358] "Generic (PLEG): container finished" podID="ac61bc8b-025e-4ee3-8a31-41bcdee6da26" containerID="17df464cc47f5c6119af679d9e35d253ae84ebab1badd7175968f1e5cfdeff3c" exitCode=0 Jun 02 15:09:51.714603 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.714585 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerDied","Data":"17df464cc47f5c6119af679d9e35d253ae84ebab1badd7175968f1e5cfdeff3c"} Jun 02 15:09:51.868529 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.868509 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-221.ec2.internal" event="NodeReady" Jun 02 15:09:51.868639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.868628 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 15:09:51.904606 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.904585 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bc6868765-k5vzp"] Jun 02 15:09:51.913609 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.913588 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:51.916630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.916609 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 15:09:51.916630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.916622 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 15:09:51.917018 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.916999 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 15:09:51.917357 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.917340 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-62s6w\"" Jun 02 15:09:51.917453 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.917409 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc6868765-k5vzp"] Jun 02 15:09:51.921654 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.921632 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-65v88"] Jun 02 15:09:51.922451 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.922432 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 15:09:51.930035 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.930018 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hv9r6"] Jun 02 15:09:51.930203 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.930187 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:51.934015 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.933991 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htsn8\"" Jun 02 15:09:51.934113 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.934021 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 15:09:51.934113 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.934030 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 15:09:51.935081 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.935028 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 15:09:51.944241 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.944221 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hv9r6"] Jun 02 15:09:51.944241 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.944244 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-65v88"] Jun 02 15:09:51.944359 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.944345 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:51.946755 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.946738 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 15:09:51.946943 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.946928 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fhjl\"" Jun 02 15:09:51.947163 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:51.947150 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 15:09:52.048998 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.048945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhghq\" (UniqueName: \"kubernetes.io/projected/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-kube-api-access-dhghq\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:52.048998 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.048979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-installation-pull-secrets\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.049145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5d51bd-b247-4c79-afc7-1d69bb739b05-config-volume\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.049145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.049145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-image-registry-private-configuration\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.049145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-certificates\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.049145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzrx\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-kube-api-access-qjzrx\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.049387 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2lw\" (UniqueName: \"kubernetes.io/projected/7f5d51bd-b247-4c79-afc7-1d69bb739b05-kube-api-access-sc2lw\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.049387 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae170e73-17bb-4217-85df-9e8e7c4843b5-ca-trust-extracted\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.049387 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-bound-sa-token\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.049387 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049311 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5d51bd-b247-4c79-afc7-1d69bb739b05-tmp-dir\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.049387 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:52.049387 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.049387 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.049378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-trusted-ca\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150298 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150273 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5d51bd-b247-4c79-afc7-1d69bb739b05-tmp-dir\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.150406 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150302 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:52.150406 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150331 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.150406 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150368 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-trusted-ca\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150406 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150393 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhghq\" (UniqueName: \"kubernetes.io/projected/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-kube-api-access-dhghq\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.150418 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.150475 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:52.650456195 +0000 UTC m=+38.639086031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150419 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-installation-pull-secrets\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.150509 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150517 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5d51bd-b247-4c79-afc7-1d69bb739b05-config-volume\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.150546 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:52.650534569 +0000 UTC m=+38.639164414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150563 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150599 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150598 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-image-registry-private-configuration\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5d51bd-b247-4c79-afc7-1d69bb739b05-tmp-dir\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-certificates\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150668 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzrx\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-kube-api-access-qjzrx\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.150688 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.150703 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150726 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2lw\" (UniqueName: \"kubernetes.io/projected/7f5d51bd-b247-4c79-afc7-1d69bb739b05-kube-api-access-sc2lw\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.150750 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:52.65073287 +0000 UTC m=+38.639362703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150773 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae170e73-17bb-4217-85df-9e8e7c4843b5-ca-trust-extracted\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.150931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.150793 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-bound-sa-token\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.151334 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.151015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5d51bd-b247-4c79-afc7-1d69bb739b05-config-volume\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.151334 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.151198 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae170e73-17bb-4217-85df-9e8e7c4843b5-ca-trust-extracted\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.151415 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.151332 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-certificates\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.151636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.151615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-trusted-ca\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.154484 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.154461 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-installation-pull-secrets\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.154563 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.154502 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-image-registry-private-configuration\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.159871 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.159846 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2lw\" (UniqueName: \"kubernetes.io/projected/7f5d51bd-b247-4c79-afc7-1d69bb739b05-kube-api-access-sc2lw\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.160212 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.160155 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-bound-sa-token\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.160297 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.160254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzrx\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-kube-api-access-qjzrx\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.160297 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.160271 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhghq\" (UniqueName: \"kubernetes.io/projected/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-kube-api-access-dhghq\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:52.352618 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.352558 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:52.352724 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.352654 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:52.352760 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.352730 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret podName:ccd6dfbf-ac8a-4657-839c-33555a71e2b9 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:24.352717797 +0000 UTC m=+70.341347627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret") pod "global-pull-secret-syncer-tzn79" (UID: "ccd6dfbf-ac8a-4657-839c-33555a71e2b9") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:09:52.655322 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.655252 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:52.655322 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.655284 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:52.655322 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.655312 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:52.655570 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.655393 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:09:52.655570 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.655392 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:52.655570 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.655403 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:09:52.655570 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.655392 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:52.655570 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.655468 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:53.655448502 +0000 UTC m=+39.644078332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:09:52.655570 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.655534 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:53.655521156 +0000 UTC m=+39.644150987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:09:52.655570 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:52.655551 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:53.655542024 +0000 UTC m=+39.644171855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:09:52.719273 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.719247 2575 generic.go:358] "Generic (PLEG): container finished" podID="ac61bc8b-025e-4ee3-8a31-41bcdee6da26" containerID="b28d124ecf477597f54defb09bed7b61ca4c818599e4c177abf67d7a9faccbef" exitCode=0 Jun 02 15:09:52.719692 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:52.719288 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerDied","Data":"b28d124ecf477597f54defb09bed7b61ca4c818599e4c177abf67d7a9faccbef"} Jun 02 15:09:53.582045 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.582020 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:09:53.582150 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.582119 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:09:53.582150 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.582146 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:09:53.586971 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.586948 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:09:53.587098 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.586977 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 15:09:53.588201 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.588162 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fnhpd\"" Jun 02 15:09:53.588309 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.588186 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:09:53.588309 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.588292 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4btz\"" Jun 02 15:09:53.588553 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.588322 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:09:53.661861 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.661837 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:53.661955 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.661893 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:53.662004 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:53.661966 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:53.662004 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:53.661970 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:09:53.662004 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:53.661982 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:09:53.662004 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:53.662004 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:55.661992196 +0000 UTC m=+41.650622026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:09:53.662223 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.662036 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:53.662223 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:53.662073 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:55.662057668 +0000 UTC m=+41.650687503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:09:53.662223 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:53.662097 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:53.662223 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:53.662130 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:55.662120936 +0000 UTC m=+41.650750767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:09:53.724518 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.724464 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-94tzf" event={"ID":"ac61bc8b-025e-4ee3-8a31-41bcdee6da26","Type":"ContainerStarted","Data":"57429eaf08eb6981dc044c839a10be7a387df310914ac872376b9a47bdd39e68"} Jun 02 15:09:53.748748 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:53.748691 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-94tzf" podStartSLOduration=6.045305793 podStartE2EDuration="39.748677119s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:09:16.761482007 +0000 UTC m=+2.750111852" lastFinishedPulling="2026-06-02 15:09:50.464853336 +0000 UTC m=+36.453483178" observedRunningTime="2026-06-02 15:09:53.747192733 +0000 UTC m=+39.735822585" watchObservedRunningTime="2026-06-02 15:09:53.748677119 +0000 UTC m=+39.737306975" Jun 02 15:09:55.676420 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:55.676344 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:55.676420 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:55.676382 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:55.676420 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:55.676417 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:55.676836 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:55.676482 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:55.677032 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:55.677018 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:59.677004253 +0000 UTC m=+45.665634087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:09:55.677074 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:55.676527 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:09:55.677074 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:55.677058 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:09:55.677074 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:55.676547 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:55.677165 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:55.677106 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:59.677090619 +0000 UTC m=+45.665720449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:09:55.677165 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:55.677117 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:09:59.677112032 +0000 UTC m=+45.665741862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:09:59.704106 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:59.704060 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:59.704155 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:09:59.704194 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:59.704234 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:59.704254 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:59.704299 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:59.704309 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:07.704294146 +0000 UTC m=+53.692923976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:59.704344 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:07.704333185 +0000 UTC m=+53.692963021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:59.704300 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:09:59.704490 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:09:59.704373 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:07.70436391 +0000 UTC m=+53.692993742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:10:07.762498 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:07.762460 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:07.762551 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:07.762575 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:07.762598 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:07.762619 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:07.762670 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:23.762654568 +0000 UTC m=+69.751284399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:07.762672 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:07.762698 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:07.762709 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:23.762697666 +0000 UTC m=+69.751327497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:10:07.762962 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:07.762764 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:23.762746269 +0000 UTC m=+69.751376105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:10:17.714099 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:17.714073 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q62qb" Jun 02 15:10:20.247349 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.247315 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:10:20.251194 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.251163 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:10:20.257889 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:20.257875 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:10:20.257975 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:20.257927 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:11:24.257911512 +0000 UTC m=+130.246541343 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : secret "metrics-daemon-secret" not found Jun 02 15:10:20.348069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.348031 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:10:20.351454 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.351436 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:10:20.361998 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.361978 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:10:20.372778 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.372755 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cggq9\" (UniqueName: \"kubernetes.io/projected/66ea6704-b48a-4f59-8fe3-8e64ee4e99a1-kube-api-access-cggq9\") pod \"network-check-target-zvz4n\" (UID: \"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1\") " pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:10:20.594605 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.594578 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4btz\"" Jun 02 15:10:20.602380 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.602362 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:10:20.730033 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.730001 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvz4n"] Jun 02 15:10:20.733909 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:10:20.733884 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ea6704_b48a_4f59_8fe3_8e64ee4e99a1.slice/crio-7d906701c50a1e85bda91023e37b6f29e545c74748d2f6a8b05617a0b8a6c7c1 WatchSource:0}: Error finding container 7d906701c50a1e85bda91023e37b6f29e545c74748d2f6a8b05617a0b8a6c7c1: Status 404 returned error can't find the container with id 7d906701c50a1e85bda91023e37b6f29e545c74748d2f6a8b05617a0b8a6c7c1 Jun 02 15:10:20.768697 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:20.768665 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvz4n" event={"ID":"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1","Type":"ContainerStarted","Data":"7d906701c50a1e85bda91023e37b6f29e545c74748d2f6a8b05617a0b8a6c7c1"} Jun 02 15:10:23.774734 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:23.774696 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:23.774748 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:23.774787 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:23.774837 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:23.774897 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:23.774900 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:23.774947 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:23.774907 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:55.774885821 +0000 UTC m=+101.763515670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:23.774987 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:55.774974796 +0000 UTC m=+101.763604627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:10:23.775220 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:23.775002 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:10:55.774993258 +0000 UTC m=+101.763623095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:10:24.380337 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.380307 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:10:24.383738 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.383718 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 15:10:24.393235 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.393216 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccd6dfbf-ac8a-4657-839c-33555a71e2b9-original-pull-secret\") pod \"global-pull-secret-syncer-tzn79\" (UID: \"ccd6dfbf-ac8a-4657-839c-33555a71e2b9\") " pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:10:24.497736 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.497697 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzn79" Jun 02 15:10:24.627359 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.627330 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tzn79"] Jun 02 15:10:24.630182 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:10:24.630144 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd6dfbf_ac8a_4657_839c_33555a71e2b9.slice/crio-9b9d7ca1050725212b5aa944f7eb227c06ddd696af9ba4805518d38a61d57807 WatchSource:0}: Error finding container 9b9d7ca1050725212b5aa944f7eb227c06ddd696af9ba4805518d38a61d57807: Status 404 returned error can't find the container with id 9b9d7ca1050725212b5aa944f7eb227c06ddd696af9ba4805518d38a61d57807 Jun 02 15:10:24.776257 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.776226 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvz4n" event={"ID":"66ea6704-b48a-4f59-8fe3-8e64ee4e99a1","Type":"ContainerStarted","Data":"9e1aa0d574e642daf2f572a4a1ea8cd7383841076fb08115e31e5e0fda66c449"} Jun 02 15:10:24.776613 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.776329 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:10:24.777105 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.777088 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tzn79" event={"ID":"ccd6dfbf-ac8a-4657-839c-33555a71e2b9","Type":"ContainerStarted","Data":"9b9d7ca1050725212b5aa944f7eb227c06ddd696af9ba4805518d38a61d57807"} Jun 02 15:10:24.791816 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:24.791772 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zvz4n" podStartSLOduration=67.275716936 podStartE2EDuration="1m10.791762333s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:10:20.735710651 +0000 UTC m=+66.724340483" lastFinishedPulling="2026-06-02 15:10:24.251756035 +0000 UTC m=+70.240385880" observedRunningTime="2026-06-02 15:10:24.791079351 +0000 UTC m=+70.779709207" watchObservedRunningTime="2026-06-02 15:10:24.791762333 +0000 UTC m=+70.780392186" Jun 02 15:10:29.787666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:29.787633 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tzn79" event={"ID":"ccd6dfbf-ac8a-4657-839c-33555a71e2b9","Type":"ContainerStarted","Data":"dcb76780623ee58124d3fd218bf4f76859c938c5136a034f397c3b62e6d5e219"} Jun 02 15:10:29.804874 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:29.804815 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tzn79" podStartSLOduration=65.158296446 podStartE2EDuration="1m9.804803646s" podCreationTimestamp="2026-06-02 15:09:20 +0000 UTC" firstStartedPulling="2026-06-02 15:10:24.631770907 +0000 UTC m=+70.620400742" lastFinishedPulling="2026-06-02 15:10:29.278278096 +0000 UTC m=+75.266907942" observedRunningTime="2026-06-02 15:10:29.804722436 +0000 UTC m=+75.793352290" watchObservedRunningTime="2026-06-02 15:10:29.804803646 +0000 UTC m=+75.793433496" Jun 02 15:10:55.781413 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:55.781383 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zvz4n" Jun 02 15:10:55.797749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:55.797724 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:10:55.797864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:55.797779 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:10:55.797864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:10:55.797803 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:10:55.797864 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:55.797852 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:10:55.798462 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:55.797869 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc6868765-k5vzp: secret "image-registry-tls" not found Jun 02 15:10:55.798462 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:55.797886 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:10:55.798462 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:55.797917 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls podName:ae170e73-17bb-4217-85df-9e8e7c4843b5 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:59.797902544 +0000 UTC m=+165.786532376 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls") pod "image-registry-7bc6868765-k5vzp" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5") : secret "image-registry-tls" not found Jun 02 15:10:55.798462 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:55.797934 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls podName:7f5d51bd-b247-4c79-afc7-1d69bb739b05 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:59.797922315 +0000 UTC m=+165.786552145 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls") pod "dns-default-hv9r6" (UID: "7f5d51bd-b247-4c79-afc7-1d69bb739b05") : secret "dns-default-metrics-tls" not found Jun 02 15:10:55.798462 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:55.797936 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:10:55.798462 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:10:55.798003 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert podName:7d50d78c-3fbf-4184-bda9-9b4de727ccd2 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:59.797989916 +0000 UTC m=+165.786619748 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert") pod "ingress-canary-65v88" (UID: "7d50d78c-3fbf-4184-bda9-9b4de727ccd2") : secret "canary-serving-cert" not found Jun 02 15:11:08.270340 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.270308 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7468c64bd5-lldhp"] Jun 02 15:11:08.272083 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.272061 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.278108 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:08.277722 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-stats-default\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" Jun 02 15:11:08.278108 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.278050 2575 status_manager.go:895] "Failed to get status for pod" podUID="7c287ef1-a572-40ba-ae35-9adb0e611702" pod="openshift-ingress/router-default-7468c64bd5-lldhp" err="pods \"router-default-7468c64bd5-lldhp\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" Jun 02 15:11:08.278260 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:08.278110 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" Jun 02 15:11:08.278260 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:08.278140 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 02 15:11:08.278260 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:08.278163 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-dockercfg-6ljkl\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6ljkl\"" type="*v1.Secret" Jun 02 15:11:08.278651 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:08.278628 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 02 15:11:08.278838 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:08.278817 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-metrics-certs-default\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" Jun 02 15:11:08.279115 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:08.279097 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-ingress-cert\" is forbidden: User \"system:node:ip-10-0-130-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" Jun 02 15:11:08.301828 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.301798 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7468c64bd5-lldhp"] Jun 02 15:11:08.386243 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.386219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gk6b\" (UniqueName: \"kubernetes.io/projected/7c287ef1-a572-40ba-ae35-9adb0e611702-kube-api-access-4gk6b\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.386345 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.386263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-stats-auth\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.386345 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.386283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-default-certificate\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.386345 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.386334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.386450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.386407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.487015 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.486988 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gk6b\" (UniqueName: \"kubernetes.io/projected/7c287ef1-a572-40ba-ae35-9adb0e611702-kube-api-access-4gk6b\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.487100 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.487033 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-stats-auth\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.487100 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.487053 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-default-certificate\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.487100 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.487078 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:08.487239 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:08.487183 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:09.327047 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.327019 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 15:11:09.329311 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.329269 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-stats-auth\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:09.426729 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.426704 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 15:11:09.427813 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:09.427797 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:09.927775494 +0000 UTC m=+115.916405340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : configmap references non-existent config key: service-ca.crt Jun 02 15:11:09.439993 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.439973 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 15:11:09.487431 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:09.487414 2575 secret.go:189] Couldn't get secret openshift-ingress/default-ingress-cert: failed to sync secret cache: timed out waiting for the condition Jun 02 15:11:09.487496 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:09.487434 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: failed to sync secret cache: timed out waiting for the condition Jun 02 15:11:09.487496 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:09.487474 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-default-certificate podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:09.987460187 +0000 UTC m=+115.976090017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "default-certificate" (UniqueName: "kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-default-certificate") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : failed to sync secret cache: timed out waiting for the condition Jun 02 15:11:09.487496 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:09.487488 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:09.987481358 +0000 UTC m=+115.976111188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : failed to sync secret cache: timed out waiting for the condition Jun 02 15:11:09.487755 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.487741 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 15:11:09.748028 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.747954 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6ljkl\"" Jun 02 15:11:09.817799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.817776 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 15:11:09.826446 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.826427 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gk6b\" (UniqueName: \"kubernetes.io/projected/7c287ef1-a572-40ba-ae35-9adb0e611702-kube-api-access-4gk6b\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:09.852212 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:09.852191 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 15:11:10.000226 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:10.000147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-default-certificate\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:10.000226 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:10.000196 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:10.000226 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:10.000223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:10.000409 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:10.000306 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:11:10.000409 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:10.000322 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:11.000305393 +0000 UTC m=+116.988935229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : configmap references non-existent config key: service-ca.crt Jun 02 15:11:10.000409 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:10.000355 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:11.000343899 +0000 UTC m=+116.988973730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : secret "router-metrics-certs-default" not found Jun 02 15:11:10.002363 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:10.002347 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-default-certificate\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:11.007878 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:11.007850 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:11.008279 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:11.007887 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:11.008279 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:11.007984 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:11:11.008279 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:11.008010 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:13.007992919 +0000 UTC m=+118.996622749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : configmap references non-existent config key: service-ca.crt Jun 02 15:11:11.008279 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:11.008031 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:13.008025057 +0000 UTC m=+118.996654887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : secret "router-metrics-certs-default" not found Jun 02 15:11:13.021520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:13.021480 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:13.021520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:13.021530 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:13.021932 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:13.021628 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:11:13.021932 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:13.021656 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:17.021637571 +0000 UTC m=+123.010267421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : configmap references non-existent config key: service-ca.crt Jun 02 15:11:13.021932 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:13.021679 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:17.021671957 +0000 UTC m=+123.010301787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : secret "router-metrics-certs-default" not found Jun 02 15:11:15.902131 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:15.902105 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ldbwc_abea5766-591c-41b6-82a7-20a67699acc6/dns-node-resolver/0.log" Jun 02 15:11:16.901113 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:16.901080 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8cmf_0956e794-2ecc-4bed-bf5e-0b98b72fc529/node-ca/0.log" Jun 02 15:11:17.050625 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:17.050586 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:17.051047 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:17.050636 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:17.051047 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:17.050748 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:25.050728394 +0000 UTC m=+131.039358232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : configmap references non-existent config key: service-ca.crt Jun 02 15:11:17.051047 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:17.050783 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:11:17.051047 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:17.050853 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:25.050834898 +0000 UTC m=+131.039464747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : secret "router-metrics-certs-default" not found Jun 02 15:11:24.304182 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:24.304146 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:11:24.304582 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:24.304311 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:11:24.304582 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:24.304385 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs podName:75b890ed-1d05-439e-984d-61d35ed04b3b nodeName:}" failed. No retries permitted until 2026-06-02 15:13:26.304370107 +0000 UTC m=+252.292999942 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs") pod "network-metrics-daemon-9gfmq" (UID: "75b890ed-1d05-439e-984d-61d35ed04b3b") : secret "metrics-daemon-secret" not found Jun 02 15:11:25.110149 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:25.110102 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:25.110149 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:25.110154 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:25.110385 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:25.110296 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:11:25.110385 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:25.110297 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:41.110278526 +0000 UTC m=+147.098908369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : configmap references non-existent config key: service-ca.crt Jun 02 15:11:25.110385 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:25.110360 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs podName:7c287ef1-a572-40ba-ae35-9adb0e611702 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:41.110347265 +0000 UTC m=+147.098977097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs") pod "router-default-7468c64bd5-lldhp" (UID: "7c287ef1-a572-40ba-ae35-9adb0e611702") : secret "router-metrics-certs-default" not found Jun 02 15:11:38.901910 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.901878 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l94c4"] Jun 02 15:11:38.904679 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.904664 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:38.912672 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.912651 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 15:11:38.912920 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.912907 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 15:11:38.913881 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.913866 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 15:11:38.913957 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.913883 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 15:11:38.918117 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.918101 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrdqv\"" Jun 02 15:11:38.932393 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:38.932371 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l94c4"] Jun 02 15:11:39.006552 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.006531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e87fa64-87ea-4a87-b91a-562c0272e0d0-data-volume\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.006637 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.006557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9nj\" (UniqueName: \"kubernetes.io/projected/6e87fa64-87ea-4a87-b91a-562c0272e0d0-kube-api-access-ht9nj\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.006637 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.006592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e87fa64-87ea-4a87-b91a-562c0272e0d0-crio-socket\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.006716 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.006700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e87fa64-87ea-4a87-b91a-562c0272e0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.006751 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.006730 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e87fa64-87ea-4a87-b91a-562c0272e0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107312 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107290 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e87fa64-87ea-4a87-b91a-562c0272e0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107395 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107318 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e87fa64-87ea-4a87-b91a-562c0272e0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107489 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e87fa64-87ea-4a87-b91a-562c0272e0d0-data-volume\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107530 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107498 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9nj\" (UniqueName: \"kubernetes.io/projected/6e87fa64-87ea-4a87-b91a-562c0272e0d0-kube-api-access-ht9nj\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107619 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107548 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e87fa64-87ea-4a87-b91a-562c0272e0d0-crio-socket\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107687 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e87fa64-87ea-4a87-b91a-562c0272e0d0-crio-socket\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107780 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107761 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e87fa64-87ea-4a87-b91a-562c0272e0d0-data-volume\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.107837 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.107780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e87fa64-87ea-4a87-b91a-562c0272e0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.109584 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.109568 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e87fa64-87ea-4a87-b91a-562c0272e0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.156789 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.156728 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc"] Jun 02 15:11:39.159505 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.159491 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.172495 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.172476 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jbvd5\"" Jun 02 15:11:39.172572 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.172476 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 15:11:39.172658 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.172642 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 15:11:39.200126 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.200105 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc"] Jun 02 15:11:39.200351 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.200330 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9nj\" (UniqueName: \"kubernetes.io/projected/6e87fa64-87ea-4a87-b91a-562c0272e0d0-kube-api-access-ht9nj\") pod \"insights-runtime-extractor-l94c4\" (UID: \"6e87fa64-87ea-4a87-b91a-562c0272e0d0\") " pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.208459 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.208432 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bb49267-5855-45ff-87a0-4ee3789da90e-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-slljc\" (UID: \"7bb49267-5855-45ff-87a0-4ee3789da90e\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.208561 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.208541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bb49267-5855-45ff-87a0-4ee3789da90e-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-slljc\" (UID: \"7bb49267-5855-45ff-87a0-4ee3789da90e\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.213409 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.213392 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l94c4" Jun 02 15:11:39.309524 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.309498 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bb49267-5855-45ff-87a0-4ee3789da90e-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-slljc\" (UID: \"7bb49267-5855-45ff-87a0-4ee3789da90e\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.309639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.309557 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bb49267-5855-45ff-87a0-4ee3789da90e-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-slljc\" (UID: \"7bb49267-5855-45ff-87a0-4ee3789da90e\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.310400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.310374 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bb49267-5855-45ff-87a0-4ee3789da90e-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-slljc\" (UID: \"7bb49267-5855-45ff-87a0-4ee3789da90e\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.312116 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.312093 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bb49267-5855-45ff-87a0-4ee3789da90e-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-slljc\" (UID: \"7bb49267-5855-45ff-87a0-4ee3789da90e\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.371361 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.371336 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l94c4"] Jun 02 15:11:39.375465 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:39.375442 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e87fa64_87ea_4a87_b91a_562c0272e0d0.slice/crio-bf4708611cd40f59bc82f8a4c0ffca879d6d8353a3f6c188574eee87a2fc6887 WatchSource:0}: Error finding container bf4708611cd40f59bc82f8a4c0ffca879d6d8353a3f6c188574eee87a2fc6887: Status 404 returned error can't find the container with id bf4708611cd40f59bc82f8a4c0ffca879d6d8353a3f6c188574eee87a2fc6887 Jun 02 15:11:39.468012 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.467984 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" Jun 02 15:11:39.602565 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.602537 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc"] Jun 02 15:11:39.605198 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:39.605160 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb49267_5855_45ff_87a0_4ee3789da90e.slice/crio-208f00371908e05110be79d943522fe0ae6434c07881407d8e3b79bd5455826a WatchSource:0}: Error finding container 208f00371908e05110be79d943522fe0ae6434c07881407d8e3b79bd5455826a: Status 404 returned error can't find the container with id 208f00371908e05110be79d943522fe0ae6434c07881407d8e3b79bd5455826a Jun 02 15:11:39.921357 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.921326 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l94c4" event={"ID":"6e87fa64-87ea-4a87-b91a-562c0272e0d0","Type":"ContainerStarted","Data":"b3351d2cb990f6d35f9ddbfa287b250cd565e6b88409c71d64a0240bc85900ae"} Jun 02 15:11:39.921357 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.921362 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l94c4" event={"ID":"6e87fa64-87ea-4a87-b91a-562c0272e0d0","Type":"ContainerStarted","Data":"bf4708611cd40f59bc82f8a4c0ffca879d6d8353a3f6c188574eee87a2fc6887"} Jun 02 15:11:39.922299 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:39.922278 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" event={"ID":"7bb49267-5855-45ff-87a0-4ee3789da90e","Type":"ContainerStarted","Data":"208f00371908e05110be79d943522fe0ae6434c07881407d8e3b79bd5455826a"} Jun 02 15:11:40.926603 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:40.926558 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l94c4" event={"ID":"6e87fa64-87ea-4a87-b91a-562c0272e0d0","Type":"ContainerStarted","Data":"f211d039ecefe975f6fde44429b5ae908c77d6546661e08f6627bba840b74cd5"} Jun 02 15:11:41.126863 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.126826 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:41.127045 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.126888 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:41.127521 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.127496 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c287ef1-a572-40ba-ae35-9adb0e611702-service-ca-bundle\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:41.129547 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.129522 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c287ef1-a572-40ba-ae35-9adb0e611702-metrics-certs\") pod \"router-default-7468c64bd5-lldhp\" (UID: \"7c287ef1-a572-40ba-ae35-9adb0e611702\") " pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:41.284558 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.284532 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6ljkl\"" Jun 02 15:11:41.291424 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.291391 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:41.501118 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.501058 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7468c64bd5-lldhp"] Jun 02 15:11:41.504152 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:41.504126 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c287ef1_a572_40ba_ae35_9adb0e611702.slice/crio-14ac530d715fc4161a468aa27ede41a3a1b39f9d4bfdebd2d46ca4f1c61a6454 WatchSource:0}: Error finding container 14ac530d715fc4161a468aa27ede41a3a1b39f9d4bfdebd2d46ca4f1c61a6454: Status 404 returned error can't find the container with id 14ac530d715fc4161a468aa27ede41a3a1b39f9d4bfdebd2d46ca4f1c61a6454 Jun 02 15:11:41.929949 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.929906 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7468c64bd5-lldhp" event={"ID":"7c287ef1-a572-40ba-ae35-9adb0e611702","Type":"ContainerStarted","Data":"14ac530d715fc4161a468aa27ede41a3a1b39f9d4bfdebd2d46ca4f1c61a6454"} Jun 02 15:11:41.931438 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.931404 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" event={"ID":"7bb49267-5855-45ff-87a0-4ee3789da90e","Type":"ContainerStarted","Data":"ddf0133de1609123e40d043e99b9ce429a5ffe64cf1d995b4d7d5a085546f536"} Jun 02 15:11:41.953419 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:41.953373 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-slljc" podStartSLOduration=1.150910566 podStartE2EDuration="2.95335617s" podCreationTimestamp="2026-06-02 15:11:39 +0000 UTC" firstStartedPulling="2026-06-02 15:11:39.607009448 +0000 UTC m=+145.595639278" lastFinishedPulling="2026-06-02 15:11:41.409455036 +0000 UTC m=+147.398084882" observedRunningTime="2026-06-02 15:11:41.951976248 +0000 UTC m=+147.940606166" watchObservedRunningTime="2026-06-02 15:11:41.95335617 +0000 UTC m=+147.941986023" Jun 02 15:11:42.936121 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:42.936091 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l94c4" event={"ID":"6e87fa64-87ea-4a87-b91a-562c0272e0d0","Type":"ContainerStarted","Data":"67dc8d4e998b2b9ae89f738d7a726758363453ae99606d30aca2b7374b0b31d1"} Jun 02 15:11:42.937377 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:42.937356 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7468c64bd5-lldhp" event={"ID":"7c287ef1-a572-40ba-ae35-9adb0e611702","Type":"ContainerStarted","Data":"767da20e34f4d114dc04172f7a290938c8e3597e417c54ae3e2b3fdc1b04e76c"} Jun 02 15:11:42.961005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:42.960962 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l94c4" podStartSLOduration=2.3470048 podStartE2EDuration="4.960952393s" podCreationTimestamp="2026-06-02 15:11:38 +0000 UTC" firstStartedPulling="2026-06-02 15:11:39.43323845 +0000 UTC m=+145.421868282" lastFinishedPulling="2026-06-02 15:11:42.047186028 +0000 UTC m=+148.035815875" observedRunningTime="2026-06-02 15:11:42.960078763 +0000 UTC m=+148.948708636" watchObservedRunningTime="2026-06-02 15:11:42.960952393 +0000 UTC m=+148.949582304" Jun 02 15:11:42.980785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:42.980745 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7468c64bd5-lldhp" podStartSLOduration=34.980734651 podStartE2EDuration="34.980734651s" podCreationTimestamp="2026-06-02 15:11:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:11:42.97998788 +0000 UTC m=+148.968617735" watchObservedRunningTime="2026-06-02 15:11:42.980734651 +0000 UTC m=+148.969364503" Jun 02 15:11:43.167540 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.167514 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr"] Jun 02 15:11:43.170419 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.170405 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" Jun 02 15:11:43.173089 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.173066 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 15:11:43.173214 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.173089 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kp25n\"" Jun 02 15:11:43.181219 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.181199 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr"] Jun 02 15:11:43.242270 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.242211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2f728f20-e4ae-452c-b2a4-4aa6f06b3b99-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jpflr\" (UID: \"2f728f20-e4ae-452c-b2a4-4aa6f06b3b99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" Jun 02 15:11:43.291538 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.291520 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:43.293798 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.293782 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:43.343485 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.343457 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2f728f20-e4ae-452c-b2a4-4aa6f06b3b99-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jpflr\" (UID: \"2f728f20-e4ae-452c-b2a4-4aa6f06b3b99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" Jun 02 15:11:43.345701 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.345681 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2f728f20-e4ae-452c-b2a4-4aa6f06b3b99-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jpflr\" (UID: \"2f728f20-e4ae-452c-b2a4-4aa6f06b3b99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" Jun 02 15:11:43.478873 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.478848 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" Jun 02 15:11:43.601110 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.599824 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr"] Jun 02 15:11:43.603638 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:43.603607 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f728f20_e4ae_452c_b2a4_4aa6f06b3b99.slice/crio-a33779de5815bbf93dabba413e35c91af906843d5de8e68313b93fd18c26c6c6 WatchSource:0}: Error finding container a33779de5815bbf93dabba413e35c91af906843d5de8e68313b93fd18c26c6c6: Status 404 returned error can't find the container with id a33779de5815bbf93dabba413e35c91af906843d5de8e68313b93fd18c26c6c6 Jun 02 15:11:43.942471 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.942442 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" event={"ID":"2f728f20-e4ae-452c-b2a4-4aa6f06b3b99","Type":"ContainerStarted","Data":"a33779de5815bbf93dabba413e35c91af906843d5de8e68313b93fd18c26c6c6"} Jun 02 15:11:43.942868 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.942849 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:43.944038 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:43.944018 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7468c64bd5-lldhp" Jun 02 15:11:45.573753 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.573726 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d46746bbb-zrftz"] Jun 02 15:11:45.576700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.576686 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.579305 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.579275 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 15:11:45.579407 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.579363 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 15:11:45.579407 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.579365 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 15:11:45.580322 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.580306 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 15:11:45.580435 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.580419 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 15:11:45.580495 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.580439 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 15:11:45.580705 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.580690 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vzncx\"" Jun 02 15:11:45.580893 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.580877 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 15:11:45.587504 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.587484 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d46746bbb-zrftz"] Jun 02 15:11:45.662279 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.662251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-serving-cert\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.662377 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.662306 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cg2r\" (UniqueName: \"kubernetes.io/projected/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-kube-api-access-8cg2r\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.662377 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.662346 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-config\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.662454 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.662405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-oauth-serving-cert\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.662454 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.662431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-service-ca\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.662517 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.662450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-oauth-config\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.763380 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.763352 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-serving-cert\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.763492 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.763421 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cg2r\" (UniqueName: \"kubernetes.io/projected/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-kube-api-access-8cg2r\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.763492 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.763466 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-config\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.763576 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.763508 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-oauth-serving-cert\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.763576 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.763533 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-service-ca\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.763576 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.763561 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-oauth-config\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.764272 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.764248 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-oauth-serving-cert\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.764272 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.764265 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-service-ca\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.764408 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.764273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-config\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.765750 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.765727 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-serving-cert\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.765836 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.765818 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-oauth-config\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.776050 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.776024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cg2r\" (UniqueName: \"kubernetes.io/projected/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-kube-api-access-8cg2r\") pod \"console-d46746bbb-zrftz\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.885911 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.885849 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:45.949054 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:45.949019 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" event={"ID":"2f728f20-e4ae-452c-b2a4-4aa6f06b3b99","Type":"ContainerStarted","Data":"af6277452ed236093247fcbf482262fe746413d1933705d8ee0feac4bcb304f3"} Jun 02 15:11:46.006371 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:46.006269 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" podStartSLOduration=1.595693415 podStartE2EDuration="3.006251263s" podCreationTimestamp="2026-06-02 15:11:43 +0000 UTC" firstStartedPulling="2026-06-02 15:11:43.605661106 +0000 UTC m=+149.594290942" lastFinishedPulling="2026-06-02 15:11:45.016218956 +0000 UTC m=+151.004848790" observedRunningTime="2026-06-02 15:11:45.979736392 +0000 UTC m=+151.968366246" watchObservedRunningTime="2026-06-02 15:11:46.006251263 +0000 UTC m=+151.994881117" Jun 02 15:11:46.007058 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:46.007038 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d46746bbb-zrftz"] Jun 02 15:11:46.010285 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:46.010265 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5eeea32_adc4_453d_bc3b_19fbca31a5d5.slice/crio-1b18917aabbb075b3374cfe2c570f304c60cd3563eaab2a545622a6df1581c8e WatchSource:0}: Error finding container 1b18917aabbb075b3374cfe2c570f304c60cd3563eaab2a545622a6df1581c8e: Status 404 returned error can't find the container with id 1b18917aabbb075b3374cfe2c570f304c60cd3563eaab2a545622a6df1581c8e Jun 02 15:11:46.952130 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:46.952095 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d46746bbb-zrftz" event={"ID":"b5eeea32-adc4-453d-bc3b-19fbca31a5d5","Type":"ContainerStarted","Data":"1b18917aabbb075b3374cfe2c570f304c60cd3563eaab2a545622a6df1581c8e"} Jun 02 15:11:46.952591 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:46.952400 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" Jun 02 15:11:46.956921 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:46.956902 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jpflr" Jun 02 15:11:50.962770 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:50.962688 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d46746bbb-zrftz" event={"ID":"b5eeea32-adc4-453d-bc3b-19fbca31a5d5","Type":"ContainerStarted","Data":"68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3"} Jun 02 15:11:50.983630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:50.983583 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d46746bbb-zrftz" podStartSLOduration=1.326188283 podStartE2EDuration="5.983567296s" podCreationTimestamp="2026-06-02 15:11:45 +0000 UTC" firstStartedPulling="2026-06-02 15:11:46.011941016 +0000 UTC m=+152.000570848" lastFinishedPulling="2026-06-02 15:11:50.669320013 +0000 UTC m=+156.657949861" observedRunningTime="2026-06-02 15:11:50.982886358 +0000 UTC m=+156.971516211" watchObservedRunningTime="2026-06-02 15:11:50.983567296 +0000 UTC m=+156.972197148" Jun 02 15:11:52.625308 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.625274 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8lgmq"] Jun 02 15:11:52.627452 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.627436 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.630598 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.630574 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 15:11:52.630881 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.630863 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 15:11:52.630953 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.630894 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 15:11:52.630953 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.630895 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 15:11:52.632082 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.632064 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 15:11:52.632147 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.632086 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 15:11:52.632147 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.632086 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89m2r\"" Jun 02 15:11:52.718298 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-textfile\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-sys\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-tls\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718437 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-wtmp\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-root\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-metrics-client-ca\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.718639 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.718601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9px6\" (UniqueName: \"kubernetes.io/projected/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-kube-api-access-q9px6\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819202 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819162 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-sys\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-sys\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819253 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-tls\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819272 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-wtmp\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819295 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-root\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819316 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-metrics-client-ca\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819658 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819357 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-root\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819658 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819361 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819658 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:52.819389 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 15:11:52.819658 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819413 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9px6\" (UniqueName: \"kubernetes.io/projected/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-kube-api-access-q9px6\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819658 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819422 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-wtmp\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819658 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819450 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-textfile\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.819658 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:52.819468 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-tls podName:7683e488-037a-4ec9-bd4a-f5c4d58d5ec3 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:53.31944596 +0000 UTC m=+159.308075793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-tls") pod "node-exporter-8lgmq" (UID: "7683e488-037a-4ec9-bd4a-f5c4d58d5ec3") : secret "node-exporter-tls" not found Jun 02 15:11:52.820019 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819822 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-textfile\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.820019 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.819967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-metrics-client-ca\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.821422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.821397 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.821552 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.821536 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:52.828778 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:52.828759 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9px6\" (UniqueName: \"kubernetes.io/projected/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-kube-api-access-q9px6\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:53.323259 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.323232 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-tls\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:53.325422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.325405 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7683e488-037a-4ec9-bd4a-f5c4d58d5ec3-node-exporter-tls\") pod \"node-exporter-8lgmq\" (UID: \"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3\") " pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:53.536011 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.535981 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8lgmq" Jun 02 15:11:53.543744 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:53.543716 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7683e488_037a_4ec9_bd4a_f5c4d58d5ec3.slice/crio-396cf1038be47b6062cfb607e4d9b2ef2507f5da8f7aacc50faf4aa2a02068f8 WatchSource:0}: Error finding container 396cf1038be47b6062cfb607e4d9b2ef2507f5da8f7aacc50faf4aa2a02068f8: Status 404 returned error can't find the container with id 396cf1038be47b6062cfb607e4d9b2ef2507f5da8f7aacc50faf4aa2a02068f8 Jun 02 15:11:53.655861 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.655804 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:11:53.658774 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.658759 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.661475 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.661454 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 15:11:53.661596 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.661474 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 15:11:53.661596 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.661454 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 15:11:53.661596 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.661454 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 15:11:53.661812 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.661796 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 15:11:53.661812 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.661805 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 15:11:53.661812 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.661822 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 15:11:53.662081 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.662040 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7phsr\"" Jun 02 15:11:53.662121 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.662068 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 15:11:53.662351 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.662337 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 15:11:53.677187 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.677151 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:11:53.726363 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726465 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726465 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726557 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726557 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726634 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726634 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-web-config\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726634 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzsqv\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-kube-api-access-vzsqv\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726777 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-config-out\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726777 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726777 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726914 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.726914 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.726836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827501 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827469 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-web-config\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827501 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827506 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzsqv\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-kube-api-access-vzsqv\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827641 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-config-out\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827695 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827654 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827748 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827698 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827748 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827735 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827844 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827796 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.827950 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827930 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828008 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827980 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828008 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.827998 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828110 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.828022 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828110 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.828080 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828233 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.828111 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828233 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.828192 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828331 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:53.828306 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 15:11:53.828382 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:53.828364 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls podName:c0e63285-299b-4f93-87d1-414e0e418010 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:54.328344699 +0000 UTC m=+160.316974755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c0e63285-299b-4f93-87d1-414e0e418010") : secret "alertmanager-main-tls" not found Jun 02 15:11:53.828693 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.828669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.828813 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:53.828797 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle podName:c0e63285-299b-4f93-87d1-414e0e418010 nodeName:}" failed. No retries permitted until 2026-06-02 15:11:54.328778521 +0000 UTC m=+160.317408365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c0e63285-299b-4f93-87d1-414e0e418010") : configmap references non-existent config key: ca-bundle.crt Jun 02 15:11:53.830291 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.830268 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-config-out\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.830457 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.830434 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-web-config\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.830544 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.830524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.830626 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.830608 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.830978 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.830950 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.831187 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.831154 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.831648 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.831628 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.831719 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.831704 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.838435 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.838416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzsqv\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-kube-api-access-vzsqv\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:53.972408 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:53.972354 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lgmq" event={"ID":"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3","Type":"ContainerStarted","Data":"396cf1038be47b6062cfb607e4d9b2ef2507f5da8f7aacc50faf4aa2a02068f8"} Jun 02 15:11:54.332903 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.332877 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:54.333056 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.332939 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:54.333770 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.333744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:54.335593 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.335567 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:54.568151 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.568121 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:11:54.812060 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.811514 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:11:54.955713 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:54.955657 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" podUID="ae170e73-17bb-4217-85df-9e8e7c4843b5" Jun 02 15:11:54.961783 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:54.961760 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-65v88" podUID="7d50d78c-3fbf-4184-bda9-9b4de727ccd2" Jun 02 15:11:54.965844 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:54.965827 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hv9r6" podUID="7f5d51bd-b247-4c79-afc7-1d69bb739b05" Jun 02 15:11:54.975564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.975537 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerStarted","Data":"dbfd6a4bddac458a71425c41d6a0a069c42940cd4009bf6b088e17f809f79821"} Jun 02 15:11:54.976755 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.976736 2575 generic.go:358] "Generic (PLEG): container finished" podID="7683e488-037a-4ec9-bd4a-f5c4d58d5ec3" containerID="df53dda7f7812bda8fee6ee9dbbaf3897970774b75b2462c5cf3ccbdbf6e3c9d" exitCode=0 Jun 02 15:11:54.976821 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.976767 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lgmq" event={"ID":"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3","Type":"ContainerDied","Data":"df53dda7f7812bda8fee6ee9dbbaf3897970774b75b2462c5cf3ccbdbf6e3c9d"} Jun 02 15:11:54.976821 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.976812 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:11:54.976895 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:54.976817 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:11:55.885969 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:55.885933 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:55.886410 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:55.885984 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:11:55.887391 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:55.887360 2575 patch_prober.go:28] interesting pod/console-d46746bbb-zrftz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body= Jun 02 15:11:55.887517 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:55.887416 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-d46746bbb-zrftz" podUID="b5eeea32-adc4-453d-bc3b-19fbca31a5d5" containerName="console" probeResult="failure" output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused" Jun 02 15:11:55.981609 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:55.981579 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lgmq" event={"ID":"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3","Type":"ContainerStarted","Data":"62b330d51f991061109c66071a3a72f97cd923feb17c579dfd829c580d027ed0"} Jun 02 15:11:55.981776 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:55.981615 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lgmq" event={"ID":"7683e488-037a-4ec9-bd4a-f5c4d58d5ec3","Type":"ContainerStarted","Data":"f038725adbc74718754abf71cef33a4ae219a1543b7c1799aec65c99a9e9ff76"} Jun 02 15:11:56.005291 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.005245 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8lgmq" podStartSLOduration=2.850052007 podStartE2EDuration="4.005231632s" podCreationTimestamp="2026-06-02 15:11:52 +0000 UTC" firstStartedPulling="2026-06-02 15:11:53.545534443 +0000 UTC m=+159.534164287" lastFinishedPulling="2026-06-02 15:11:54.700714068 +0000 UTC m=+160.689343912" observedRunningTime="2026-06-02 15:11:56.00354049 +0000 UTC m=+161.992170367" watchObservedRunningTime="2026-06-02 15:11:56.005231632 +0000 UTC m=+161.993861484" Jun 02 15:11:56.602249 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:11:56.602211 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9gfmq" podUID="75b890ed-1d05-439e-984d-61d35ed04b3b" Jun 02 15:11:56.886847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.886773 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77f48b67c4-g2qld"] Jun 02 15:11:56.889892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.889876 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:56.892542 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.892525 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 15:11:56.893638 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.893613 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2etq7hsdk60j1\"" Jun 02 15:11:56.893742 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.893675 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z7hm7\"" Jun 02 15:11:56.893742 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.893692 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 15:11:56.893742 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.893678 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 15:11:56.893883 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.893777 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 15:11:56.900183 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.900155 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77f48b67c4-g2qld"] Jun 02 15:11:56.985949 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.985925 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0e63285-299b-4f93-87d1-414e0e418010" containerID="26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a" exitCode=0 Jun 02 15:11:56.986074 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:56.986019 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a"} Jun 02 15:11:57.056390 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.056364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5ca4376f-d869-4a29-a444-7bcac7ee372e-metrics-server-audit-profiles\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.056601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.056578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5ca4376f-d869-4a29-a444-7bcac7ee372e-audit-log\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.056733 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.056717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggvc5\" (UniqueName: \"kubernetes.io/projected/5ca4376f-d869-4a29-a444-7bcac7ee372e-kube-api-access-ggvc5\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.056895 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.056875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-secret-metrics-server-client-certs\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.056958 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.056929 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ca4376f-d869-4a29-a444-7bcac7ee372e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.057023 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.057007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-client-ca-bundle\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.057915 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.057879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-secret-metrics-server-tls\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.158913 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.158851 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5ca4376f-d869-4a29-a444-7bcac7ee372e-audit-log\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.158913 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.158892 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggvc5\" (UniqueName: \"kubernetes.io/projected/5ca4376f-d869-4a29-a444-7bcac7ee372e-kube-api-access-ggvc5\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.158947 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-secret-metrics-server-client-certs\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.158977 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ca4376f-d869-4a29-a444-7bcac7ee372e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.159009 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-client-ca-bundle\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.159041 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-secret-metrics-server-tls\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159286 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.159076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5ca4376f-d869-4a29-a444-7bcac7ee372e-metrics-server-audit-profiles\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159364 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.159344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5ca4376f-d869-4a29-a444-7bcac7ee372e-audit-log\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159707 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.159685 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ca4376f-d869-4a29-a444-7bcac7ee372e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.159902 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.159886 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5ca4376f-d869-4a29-a444-7bcac7ee372e-metrics-server-audit-profiles\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.161480 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.161459 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-secret-metrics-server-tls\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.161853 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.161836 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-client-ca-bundle\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.162028 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.161999 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5ca4376f-d869-4a29-a444-7bcac7ee372e-secret-metrics-server-client-certs\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.167650 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.167620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggvc5\" (UniqueName: \"kubernetes.io/projected/5ca4376f-d869-4a29-a444-7bcac7ee372e-kube-api-access-ggvc5\") pod \"metrics-server-77f48b67c4-g2qld\" (UID: \"5ca4376f-d869-4a29-a444-7bcac7ee372e\") " pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.198573 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.198552 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:11:57.319829 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.319805 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77f48b67c4-g2qld"] Jun 02 15:11:57.322505 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:57.322465 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca4376f_d869_4a29_a444_7bcac7ee372e.slice/crio-56ef09fc2199d9cfcd6aae821f7862ae4e7636ca92f87f0014d4c7b0129ec9ed WatchSource:0}: Error finding container 56ef09fc2199d9cfcd6aae821f7862ae4e7636ca92f87f0014d4c7b0129ec9ed: Status 404 returned error can't find the container with id 56ef09fc2199d9cfcd6aae821f7862ae4e7636ca92f87f0014d4c7b0129ec9ed Jun 02 15:11:57.776780 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.776743 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d46746bbb-zrftz"] Jun 02 15:11:57.806644 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.806618 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7874b6d9b6-lscvq"] Jun 02 15:11:57.809640 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.809620 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.817491 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.817472 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 15:11:57.818534 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.818513 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7874b6d9b6-lscvq"] Jun 02 15:11:57.966900 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.966865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzg8q\" (UniqueName: \"kubernetes.io/projected/0c5c5b05-0872-462c-aece-1d3c0d6a4008-kube-api-access-tzg8q\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.967293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.966919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-trusted-ca-bundle\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.967293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.966940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-service-ca\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.967293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.966961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-oauth-config\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.967293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.966984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-config\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.967293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.967029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-oauth-serving-cert\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.967293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.967099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-serving-cert\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:57.990212 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:57.990183 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" event={"ID":"5ca4376f-d869-4a29-a444-7bcac7ee372e","Type":"ContainerStarted","Data":"56ef09fc2199d9cfcd6aae821f7862ae4e7636ca92f87f0014d4c7b0129ec9ed"} Jun 02 15:11:58.067759 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.067695 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-oauth-config\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.067759 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.067743 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-config\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.067924 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.067862 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-oauth-serving-cert\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.068091 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.068062 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-serving-cert\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.068277 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.068259 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzg8q\" (UniqueName: \"kubernetes.io/projected/0c5c5b05-0872-462c-aece-1d3c0d6a4008-kube-api-access-tzg8q\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.068355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.068332 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-trusted-ca-bundle\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.068416 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.068363 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-service-ca\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.068501 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.068478 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-config\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.068557 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.068535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-oauth-serving-cert\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.069027 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.068982 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-service-ca\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.069604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.069366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-trusted-ca-bundle\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.070707 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.070688 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-oauth-config\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.070896 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.070878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-serving-cert\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.077944 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.077925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzg8q\" (UniqueName: \"kubernetes.io/projected/0c5c5b05-0872-462c-aece-1d3c0d6a4008-kube-api-access-tzg8q\") pod \"console-7874b6d9b6-lscvq\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.119934 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.119887 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:11:58.261532 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.261281 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7874b6d9b6-lscvq"] Jun 02 15:11:58.263976 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:58.263951 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5c5b05_0872_462c_aece_1d3c0d6a4008.slice/crio-56dda0de259583b23e0b234516037b7a14e64ccb76595c0cf712c5a8b1628aa8 WatchSource:0}: Error finding container 56dda0de259583b23e0b234516037b7a14e64ccb76595c0cf712c5a8b1628aa8: Status 404 returned error can't find the container with id 56dda0de259583b23e0b234516037b7a14e64ccb76595c0cf712c5a8b1628aa8 Jun 02 15:11:58.798606 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.798571 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:11:58.802950 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.802930 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.805825 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.805806 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 15:11:58.805943 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.805828 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 15:11:58.805943 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.805859 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 15:11:58.805943 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.805830 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 15:11:58.806231 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.806210 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 15:11:58.806349 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.806260 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 15:11:58.806469 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.806424 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 15:11:58.806977 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.806950 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-237drhrjuktg3\"" Jun 02 15:11:58.807137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.807045 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 15:11:58.807255 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.807145 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 15:11:58.807255 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.807208 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 15:11:58.807255 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.807213 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l6mng\"" Jun 02 15:11:58.807409 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.807268 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 15:11:58.809795 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.809775 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 15:11:58.815561 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.815541 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:11:58.874854 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.874827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config-out\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.874868 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjqbt\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-kube-api-access-bjqbt\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.874902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.874925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.874950 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875663 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875663 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-web-config\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.875663 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.875562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976227 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976192 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976227 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976295 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976327 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976354 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976386 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976409 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976439 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.976737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977086 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.976833 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977266 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977243 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977364 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977295 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977364 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977300 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-web-config\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977478 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977371 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977478 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977429 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config-out\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977478 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977465 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjqbt\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-kube-api-access-bjqbt\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977612 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977496 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977612 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977523 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977612 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977549 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977612 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977603 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.977813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.977635 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.978710 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.978683 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.979778 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.979585 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.980159 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.980106 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.981736 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.980462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.981736 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.981181 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-web-config\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.981736 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.981609 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.981736 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.981636 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.981961 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.981927 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.982070 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.982044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config-out\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.982294 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.982273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.982482 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.982461 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.982733 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.982714 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.982887 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.982850 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.983145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.983129 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.988023 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.988003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjqbt\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-kube-api-access-bjqbt\") pod \"prometheus-k8s-0\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:58.995836 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.995810 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7874b6d9b6-lscvq" event={"ID":"0c5c5b05-0872-462c-aece-1d3c0d6a4008","Type":"ContainerStarted","Data":"0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c"} Jun 02 15:11:58.995930 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:58.995848 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7874b6d9b6-lscvq" event={"ID":"0c5c5b05-0872-462c-aece-1d3c0d6a4008","Type":"ContainerStarted","Data":"56dda0de259583b23e0b234516037b7a14e64ccb76595c0cf712c5a8b1628aa8"} Jun 02 15:11:59.015792 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.015746 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7874b6d9b6-lscvq" podStartSLOduration=2.015731123 podStartE2EDuration="2.015731123s" podCreationTimestamp="2026-06-02 15:11:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:11:59.014856125 +0000 UTC m=+165.003485980" watchObservedRunningTime="2026-06-02 15:11:59.015731123 +0000 UTC m=+165.004360960" Jun 02 15:11:59.114650 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.114582 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:11:59.594576 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.594555 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:11:59.595852 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:11:59.595822 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f10e2f_3ef8_49cd_aa5d_9f637e962aaf.slice/crio-8cc0c6b4fd70e25d7141113197f02e9401e1e0317e59a5015cba468e760145ca WatchSource:0}: Error finding container 8cc0c6b4fd70e25d7141113197f02e9401e1e0317e59a5015cba468e760145ca: Status 404 returned error can't find the container with id 8cc0c6b4fd70e25d7141113197f02e9401e1e0317e59a5015cba468e760145ca Jun 02 15:11:59.887148 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.887117 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:11:59.887315 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.887187 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:11:59.887315 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.887214 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:11:59.889502 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.889474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5d51bd-b247-4c79-afc7-1d69bb739b05-metrics-tls\") pod \"dns-default-hv9r6\" (UID: \"7f5d51bd-b247-4c79-afc7-1d69bb739b05\") " pod="openshift-dns/dns-default-hv9r6" Jun 02 15:11:59.889589 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.889575 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d50d78c-3fbf-4184-bda9-9b4de727ccd2-cert\") pod \"ingress-canary-65v88\" (UID: \"7d50d78c-3fbf-4184-bda9-9b4de727ccd2\") " pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:11:59.889589 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:11:59.889581 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"image-registry-7bc6868765-k5vzp\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:12:00.000625 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.000536 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" event={"ID":"5ca4376f-d869-4a29-a444-7bcac7ee372e","Type":"ContainerStarted","Data":"afa414d9feba821f637b26558446c095f94e3bf5feb917dc4ad751d5c7bba336"} Jun 02 15:12:00.003041 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.003015 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerStarted","Data":"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a"} Jun 02 15:12:00.003041 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.003043 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerStarted","Data":"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445"} Jun 02 15:12:00.003219 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.003057 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerStarted","Data":"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d"} Jun 02 15:12:00.003219 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.003069 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerStarted","Data":"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa"} Jun 02 15:12:00.003219 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.003080 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerStarted","Data":"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418"} Jun 02 15:12:00.004349 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.004327 2575 generic.go:358] "Generic (PLEG): container finished" podID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" exitCode=0 Jun 02 15:12:00.004450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.004402 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2"} Jun 02 15:12:00.004450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.004426 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerStarted","Data":"8cc0c6b4fd70e25d7141113197f02e9401e1e0317e59a5015cba468e760145ca"} Jun 02 15:12:00.023668 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.023628 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" podStartSLOduration=1.895394985 podStartE2EDuration="4.023616393s" podCreationTimestamp="2026-06-02 15:11:56 +0000 UTC" firstStartedPulling="2026-06-02 15:11:57.324671544 +0000 UTC m=+163.313301389" lastFinishedPulling="2026-06-02 15:11:59.452892947 +0000 UTC m=+165.441522797" observedRunningTime="2026-06-02 15:12:00.022874938 +0000 UTC m=+166.011504793" watchObservedRunningTime="2026-06-02 15:12:00.023616393 +0000 UTC m=+166.012246246" Jun 02 15:12:00.081015 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.080990 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-62s6w\"" Jun 02 15:12:00.081121 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.081054 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htsn8\"" Jun 02 15:12:00.088377 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.088359 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-65v88" Jun 02 15:12:00.088468 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.088396 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:12:00.226747 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.226712 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc6868765-k5vzp"] Jun 02 15:12:00.229782 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:12:00.229754 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae170e73_17bb_4217_85df_9e8e7c4843b5.slice/crio-34a12ae8ad049c22b63422435df6305c104fec86176410864617ab3859b9340d WatchSource:0}: Error finding container 34a12ae8ad049c22b63422435df6305c104fec86176410864617ab3859b9340d: Status 404 returned error can't find the container with id 34a12ae8ad049c22b63422435df6305c104fec86176410864617ab3859b9340d Jun 02 15:12:00.238571 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:00.238550 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-65v88"] Jun 02 15:12:00.242748 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:12:00.242720 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d50d78c_3fbf_4184_bda9_9b4de727ccd2.slice/crio-9d7844e7a377e8ac428f53fa658b3a5934c563c46bb175f0606515fae7c91a53 WatchSource:0}: Error finding container 9d7844e7a377e8ac428f53fa658b3a5934c563c46bb175f0606515fae7c91a53: Status 404 returned error can't find the container with id 9d7844e7a377e8ac428f53fa658b3a5934c563c46bb175f0606515fae7c91a53 Jun 02 15:12:01.009940 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:01.009895 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-65v88" event={"ID":"7d50d78c-3fbf-4184-bda9-9b4de727ccd2","Type":"ContainerStarted","Data":"9d7844e7a377e8ac428f53fa658b3a5934c563c46bb175f0606515fae7c91a53"} Jun 02 15:12:01.011826 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:01.011797 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" event={"ID":"ae170e73-17bb-4217-85df-9e8e7c4843b5","Type":"ContainerStarted","Data":"0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967"} Jun 02 15:12:01.011956 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:01.011833 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" event={"ID":"ae170e73-17bb-4217-85df-9e8e7c4843b5","Type":"ContainerStarted","Data":"34a12ae8ad049c22b63422435df6305c104fec86176410864617ab3859b9340d"} Jun 02 15:12:01.012021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:01.011995 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:12:01.016659 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:01.016516 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerStarted","Data":"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17"} Jun 02 15:12:01.035939 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:01.035856 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" podStartSLOduration=166.035845841 podStartE2EDuration="2m46.035845841s" podCreationTimestamp="2026-06-02 15:09:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:12:01.033008307 +0000 UTC m=+167.021638185" watchObservedRunningTime="2026-06-02 15:12:01.035845841 +0000 UTC m=+167.024475693" Jun 02 15:12:01.062061 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:01.062000 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.000054222 podStartE2EDuration="8.061985494s" podCreationTimestamp="2026-06-02 15:11:53 +0000 UTC" firstStartedPulling="2026-06-02 15:11:54.815686897 +0000 UTC m=+160.804316730" lastFinishedPulling="2026-06-02 15:12:00.877618168 +0000 UTC m=+166.866248002" observedRunningTime="2026-06-02 15:12:01.058989558 +0000 UTC m=+167.047619422" watchObservedRunningTime="2026-06-02 15:12:01.061985494 +0000 UTC m=+167.050615348" Jun 02 15:12:04.028040 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:04.028000 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerStarted","Data":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} Jun 02 15:12:04.028040 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:04.028048 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerStarted","Data":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} Jun 02 15:12:04.029274 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:04.029244 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-65v88" event={"ID":"7d50d78c-3fbf-4184-bda9-9b4de727ccd2","Type":"ContainerStarted","Data":"c1a36f9ed92d5ab14b0dc6e28a0a283bb11a40ba7c2e466f6440541ede3f3579"} Jun 02 15:12:04.053499 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:04.053458 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-65v88" podStartSLOduration=130.008740847 podStartE2EDuration="2m13.053444399s" podCreationTimestamp="2026-06-02 15:09:51 +0000 UTC" firstStartedPulling="2026-06-02 15:12:00.24532911 +0000 UTC m=+166.233958942" lastFinishedPulling="2026-06-02 15:12:03.290032659 +0000 UTC m=+169.278662494" observedRunningTime="2026-06-02 15:12:04.051564891 +0000 UTC m=+170.040194744" watchObservedRunningTime="2026-06-02 15:12:04.053444399 +0000 UTC m=+170.042074251" Jun 02 15:12:06.037355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:06.037321 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerStarted","Data":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} Jun 02 15:12:06.037355 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:06.037356 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerStarted","Data":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} Jun 02 15:12:06.037740 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:06.037366 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerStarted","Data":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} Jun 02 15:12:06.037740 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:06.037375 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerStarted","Data":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} Jun 02 15:12:06.077238 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:06.077193 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.856635669 podStartE2EDuration="8.077180637s" podCreationTimestamp="2026-06-02 15:11:58 +0000 UTC" firstStartedPulling="2026-06-02 15:12:00.005444059 +0000 UTC m=+165.994073891" lastFinishedPulling="2026-06-02 15:12:05.225989014 +0000 UTC m=+171.214618859" observedRunningTime="2026-06-02 15:12:06.074937734 +0000 UTC m=+172.063567610" watchObservedRunningTime="2026-06-02 15:12:06.077180637 +0000 UTC m=+172.065810481" Jun 02 15:12:07.582584 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:07.582532 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hv9r6" Jun 02 15:12:07.586123 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:07.586102 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fhjl\"" Jun 02 15:12:07.593867 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:07.593851 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hv9r6" Jun 02 15:12:07.716191 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:07.716137 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hv9r6"] Jun 02 15:12:07.718681 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:12:07.718655 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5d51bd_b247_4c79_afc7_1d69bb739b05.slice/crio-3dd26f16e21f14cfad511af95a0c7a0cfa7256700c2d733a13c4e53dbbafc871 WatchSource:0}: Error finding container 3dd26f16e21f14cfad511af95a0c7a0cfa7256700c2d733a13c4e53dbbafc871: Status 404 returned error can't find the container with id 3dd26f16e21f14cfad511af95a0c7a0cfa7256700c2d733a13c4e53dbbafc871 Jun 02 15:12:08.044998 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:08.044962 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hv9r6" event={"ID":"7f5d51bd-b247-4c79-afc7-1d69bb739b05","Type":"ContainerStarted","Data":"3dd26f16e21f14cfad511af95a0c7a0cfa7256700c2d733a13c4e53dbbafc871"} Jun 02 15:12:08.120401 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:08.120380 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:12:08.120532 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:08.120482 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:12:08.121655 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:08.121634 2575 patch_prober.go:28] interesting pod/console-7874b6d9b6-lscvq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jun 02 15:12:08.121760 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:08.121671 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7874b6d9b6-lscvq" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jun 02 15:12:09.114909 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:09.114880 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:12:10.051193 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:10.051138 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hv9r6" event={"ID":"7f5d51bd-b247-4c79-afc7-1d69bb739b05","Type":"ContainerStarted","Data":"ef7fae8c739ac6239f16e3ca6b3e96b8623cd19cf6a6cd4b726911b2fba7bd6a"} Jun 02 15:12:10.051193 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:10.051187 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hv9r6" event={"ID":"7f5d51bd-b247-4c79-afc7-1d69bb739b05","Type":"ContainerStarted","Data":"a170a01a910ca5ea0b1f22e32a3698f2a91e66267c84595f37dc3eff168a4037"} Jun 02 15:12:10.051429 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:10.051278 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hv9r6" Jun 02 15:12:10.072241 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:10.072199 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hv9r6" podStartSLOduration=137.129339638 podStartE2EDuration="2m19.072187748s" podCreationTimestamp="2026-06-02 15:09:51 +0000 UTC" firstStartedPulling="2026-06-02 15:12:07.720610099 +0000 UTC m=+173.709239944" lastFinishedPulling="2026-06-02 15:12:09.663458224 +0000 UTC m=+175.652088054" observedRunningTime="2026-06-02 15:12:10.072074848 +0000 UTC m=+176.060704701" watchObservedRunningTime="2026-06-02 15:12:10.072187748 +0000 UTC m=+176.060817594" Jun 02 15:12:10.582793 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:10.582758 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:12:17.198962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:17.198919 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:12:17.199476 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:17.198982 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:12:18.120737 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:18.120708 2575 patch_prober.go:28] interesting pod/console-7874b6d9b6-lscvq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jun 02 15:12:18.120915 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:18.120753 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7874b6d9b6-lscvq" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jun 02 15:12:20.055771 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:20.055743 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hv9r6" Jun 02 15:12:20.092614 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:20.092579 2575 patch_prober.go:28] interesting pod/image-registry-7bc6868765-k5vzp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 15:12:20.092764 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:20.092638 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" podUID="ae170e73-17bb-4217-85df-9e8e7c4843b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:12:22.028871 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:22.028838 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:12:22.799928 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:22.799874 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d46746bbb-zrftz" podUID="b5eeea32-adc4-453d-bc3b-19fbca31a5d5" containerName="console" containerID="cri-o://68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3" gracePeriod=15 Jun 02 15:12:23.032665 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.032644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d46746bbb-zrftz_b5eeea32-adc4-453d-bc3b-19fbca31a5d5/console/0.log" Jun 02 15:12:23.032969 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.032714 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:12:23.082219 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082113 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-service-ca\") pod \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " Jun 02 15:12:23.082219 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082193 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-serving-cert\") pod \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " Jun 02 15:12:23.082437 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082220 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-config\") pod \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " Jun 02 15:12:23.082437 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082252 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cg2r\" (UniqueName: \"kubernetes.io/projected/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-kube-api-access-8cg2r\") pod \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " Jun 02 15:12:23.082437 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082289 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-oauth-config\") pod \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " Jun 02 15:12:23.082437 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082340 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-oauth-serving-cert\") pod \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\" (UID: \"b5eeea32-adc4-453d-bc3b-19fbca31a5d5\") " Jun 02 15:12:23.082621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082582 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5eeea32-adc4-453d-bc3b-19fbca31a5d5" (UID: "b5eeea32-adc4-453d-bc3b-19fbca31a5d5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:23.082666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082645 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-config" (OuterVolumeSpecName: "console-config") pod "b5eeea32-adc4-453d-bc3b-19fbca31a5d5" (UID: "b5eeea32-adc4-453d-bc3b-19fbca31a5d5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:23.082809 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.082781 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5eeea32-adc4-453d-bc3b-19fbca31a5d5" (UID: "b5eeea32-adc4-453d-bc3b-19fbca31a5d5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:23.084734 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.084693 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-kube-api-access-8cg2r" (OuterVolumeSpecName: "kube-api-access-8cg2r") pod "b5eeea32-adc4-453d-bc3b-19fbca31a5d5" (UID: "b5eeea32-adc4-453d-bc3b-19fbca31a5d5"). InnerVolumeSpecName "kube-api-access-8cg2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:12:23.084734 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.084707 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5eeea32-adc4-453d-bc3b-19fbca31a5d5" (UID: "b5eeea32-adc4-453d-bc3b-19fbca31a5d5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:12:23.087299 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.087272 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5eeea32-adc4-453d-bc3b-19fbca31a5d5" (UID: "b5eeea32-adc4-453d-bc3b-19fbca31a5d5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:12:23.088475 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.088458 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d46746bbb-zrftz_b5eeea32-adc4-453d-bc3b-19fbca31a5d5/console/0.log" Jun 02 15:12:23.088564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.088495 2575 generic.go:358] "Generic (PLEG): container finished" podID="b5eeea32-adc4-453d-bc3b-19fbca31a5d5" containerID="68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3" exitCode=2 Jun 02 15:12:23.088564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.088527 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d46746bbb-zrftz" event={"ID":"b5eeea32-adc4-453d-bc3b-19fbca31a5d5","Type":"ContainerDied","Data":"68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3"} Jun 02 15:12:23.088564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.088549 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d46746bbb-zrftz" event={"ID":"b5eeea32-adc4-453d-bc3b-19fbca31a5d5","Type":"ContainerDied","Data":"1b18917aabbb075b3374cfe2c570f304c60cd3563eaab2a545622a6df1581c8e"} Jun 02 15:12:23.088683 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.088564 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d46746bbb-zrftz" Jun 02 15:12:23.088683 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.088574 2575 scope.go:117] "RemoveContainer" containerID="68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3" Jun 02 15:12:23.100278 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.100261 2575 scope.go:117] "RemoveContainer" containerID="68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3" Jun 02 15:12:23.100540 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:12:23.100522 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3\": container with ID starting with 68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3 not found: ID does not exist" containerID="68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3" Jun 02 15:12:23.100589 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.100548 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3"} err="failed to get container status \"68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3\": rpc error: code = NotFound desc = could not find container \"68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3\": container with ID starting with 68888aa1c0e5648bdfffcf2e0d541edc422f8450ea43d035110618d6ffaeb2c3 not found: ID does not exist" Jun 02 15:12:23.112583 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.112564 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d46746bbb-zrftz"] Jun 02 15:12:23.116362 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.116344 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d46746bbb-zrftz"] Jun 02 15:12:23.183553 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.183530 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-service-ca\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:23.183553 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.183553 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-serving-cert\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:23.183712 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.183565 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:23.183712 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.183576 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cg2r\" (UniqueName: \"kubernetes.io/projected/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-kube-api-access-8cg2r\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:23.183712 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.183584 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-console-oauth-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:23.183712 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:23.183593 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5eeea32-adc4-453d-bc3b-19fbca31a5d5-oauth-serving-cert\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:24.585744 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:24.585712 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5eeea32-adc4-453d-bc3b-19fbca31a5d5" path="/var/lib/kubelet/pods/b5eeea32-adc4-453d-bc3b-19fbca31a5d5/volumes" Jun 02 15:12:28.124354 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:28.124327 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:12:28.128137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:28.128120 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:12:29.405666 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:29.405639 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hv9r6_7f5d51bd-b247-4c79-afc7-1d69bb739b05/dns/0.log" Jun 02 15:12:29.418325 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:29.418301 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hv9r6_7f5d51bd-b247-4c79-afc7-1d69bb739b05/kube-rbac-proxy/0.log" Jun 02 15:12:29.674592 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:29.674514 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc6868765-k5vzp"] Jun 02 15:12:29.762717 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:29.762692 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ldbwc_abea5766-591c-41b6-82a7-20a67699acc6/dns-node-resolver/0.log" Jun 02 15:12:37.204284 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:37.204253 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:12:37.207993 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:37.207972 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77f48b67c4-g2qld" Jun 02 15:12:54.693431 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:54.693395 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" podUID="ae170e73-17bb-4217-85df-9e8e7c4843b5" containerName="registry" containerID="cri-o://0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967" gracePeriod=30 Jun 02 15:12:55.941859 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:55.941839 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:12:56.040756 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040686 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-bound-sa-token\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.040756 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040726 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.040756 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040751 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae170e73-17bb-4217-85df-9e8e7c4843b5-ca-trust-extracted\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.040945 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040792 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-installation-pull-secrets\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.040945 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040842 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-image-registry-private-configuration\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.040945 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040898 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjzrx\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-kube-api-access-qjzrx\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.040945 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040924 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-trusted-ca\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.041145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.040975 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-certificates\") pod \"ae170e73-17bb-4217-85df-9e8e7c4843b5\" (UID: \"ae170e73-17bb-4217-85df-9e8e7c4843b5\") " Jun 02 15:12:56.041489 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.041432 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:56.041649 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.041598 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:12:56.043142 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.043115 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:12:56.043295 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.043242 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:12:56.043507 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.043476 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:12:56.043617 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.043527 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-kube-api-access-qjzrx" (OuterVolumeSpecName: "kube-api-access-qjzrx") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "kube-api-access-qjzrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:12:56.043703 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.043685 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:12:56.049468 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.049445 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae170e73-17bb-4217-85df-9e8e7c4843b5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae170e73-17bb-4217-85df-9e8e7c4843b5" (UID: "ae170e73-17bb-4217-85df-9e8e7c4843b5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:12:56.141837 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141810 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-installation-pull-secrets\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.141837 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141835 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae170e73-17bb-4217-85df-9e8e7c4843b5-image-registry-private-configuration\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.141955 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141845 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjzrx\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-kube-api-access-qjzrx\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.141955 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141855 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-trusted-ca\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.141955 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141865 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-certificates\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.141955 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141874 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-bound-sa-token\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.141955 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141883 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae170e73-17bb-4217-85df-9e8e7c4843b5-registry-tls\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.141955 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.141891 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae170e73-17bb-4217-85df-9e8e7c4843b5-ca-trust-extracted\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:12:56.188655 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.188627 2575 generic.go:358] "Generic (PLEG): container finished" podID="ae170e73-17bb-4217-85df-9e8e7c4843b5" containerID="0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967" exitCode=0 Jun 02 15:12:56.188756 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.188693 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" event={"ID":"ae170e73-17bb-4217-85df-9e8e7c4843b5","Type":"ContainerDied","Data":"0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967"} Jun 02 15:12:56.188756 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.188705 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" Jun 02 15:12:56.188756 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.188718 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc6868765-k5vzp" event={"ID":"ae170e73-17bb-4217-85df-9e8e7c4843b5","Type":"ContainerDied","Data":"34a12ae8ad049c22b63422435df6305c104fec86176410864617ab3859b9340d"} Jun 02 15:12:56.188756 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.188732 2575 scope.go:117] "RemoveContainer" containerID="0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967" Jun 02 15:12:56.196450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.196373 2575 scope.go:117] "RemoveContainer" containerID="0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967" Jun 02 15:12:56.196768 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:12:56.196745 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967\": container with ID starting with 0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967 not found: ID does not exist" containerID="0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967" Jun 02 15:12:56.196834 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.196778 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967"} err="failed to get container status \"0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967\": rpc error: code = NotFound desc = could not find container \"0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967\": container with ID starting with 0a02b2a23c3c94e737d738b535c798f24891d2cb6b80a409a2bdbf69af34a967 not found: ID does not exist" Jun 02 15:12:56.212700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.212677 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc6868765-k5vzp"] Jun 02 15:12:56.216001 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.215982 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bc6868765-k5vzp"] Jun 02 15:12:56.588847 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:56.588816 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae170e73-17bb-4217-85df-9e8e7c4843b5" path="/var/lib/kubelet/pods/ae170e73-17bb-4217-85df-9e8e7c4843b5/volumes" Jun 02 15:12:59.115241 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:59.115204 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:12:59.130383 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:59.130359 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:12:59.211818 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:12:59.211797 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:12.873245 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:12.873214 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:13:12.873703 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:12.873599 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="alertmanager" containerID="cri-o://590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418" gracePeriod=120 Jun 02 15:13:12.873703 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:12.873660 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-metric" containerID="cri-o://356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a" gracePeriod=120 Jun 02 15:13:12.873703 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:12.873691 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="config-reloader" containerID="cri-o://636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa" gracePeriod=120 Jun 02 15:13:12.873871 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:12.873685 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-web" containerID="cri-o://754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d" gracePeriod=120 Jun 02 15:13:12.873871 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:12.873705 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy" containerID="cri-o://68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445" gracePeriod=120 Jun 02 15:13:12.873871 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:12.873792 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="prom-label-proxy" containerID="cri-o://e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17" gracePeriod=120 Jun 02 15:13:13.237422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237337 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0e63285-299b-4f93-87d1-414e0e418010" containerID="e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17" exitCode=0 Jun 02 15:13:13.237422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237365 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0e63285-299b-4f93-87d1-414e0e418010" containerID="68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445" exitCode=0 Jun 02 15:13:13.237422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237374 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0e63285-299b-4f93-87d1-414e0e418010" containerID="636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa" exitCode=0 Jun 02 15:13:13.237422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237381 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0e63285-299b-4f93-87d1-414e0e418010" containerID="590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418" exitCode=0 Jun 02 15:13:13.237422 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237410 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17"} Jun 02 15:13:13.237662 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237444 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445"} Jun 02 15:13:13.237662 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237455 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa"} Jun 02 15:13:13.237662 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:13.237463 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418"} Jun 02 15:13:14.112031 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.112008 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.244714 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.244636 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0e63285-299b-4f93-87d1-414e0e418010" containerID="356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a" exitCode=0 Jun 02 15:13:14.244714 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.244666 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0e63285-299b-4f93-87d1-414e0e418010" containerID="754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d" exitCode=0 Jun 02 15:13:14.244898 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.244726 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a"} Jun 02 15:13:14.244898 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.244759 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.244898 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.244771 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d"} Jun 02 15:13:14.244898 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.244787 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0e63285-299b-4f93-87d1-414e0e418010","Type":"ContainerDied","Data":"dbfd6a4bddac458a71425c41d6a0a069c42940cd4009bf6b088e17f809f79821"} Jun 02 15:13:14.244898 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.244806 2575 scope.go:117] "RemoveContainer" containerID="e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17" Jun 02 15:13:14.251143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.251125 2575 scope.go:117] "RemoveContainer" containerID="356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a" Jun 02 15:13:14.257050 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.257033 2575 scope.go:117] "RemoveContainer" containerID="68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445" Jun 02 15:13:14.263092 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.263076 2575 scope.go:117] "RemoveContainer" containerID="754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d" Jun 02 15:13:14.268827 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.268812 2575 scope.go:117] "RemoveContainer" containerID="636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa" Jun 02 15:13:14.274583 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.274568 2575 scope.go:117] "RemoveContainer" containerID="590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418" Jun 02 15:13:14.280512 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.280498 2575 scope.go:117] "RemoveContainer" containerID="26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a" Jun 02 15:13:14.283428 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283412 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283483 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283441 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-cluster-tls-config\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283533 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283479 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-main-db\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283533 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283522 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzsqv\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-kube-api-access-vzsqv\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283626 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283548 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283626 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283585 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-web-config\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283626 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283610 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-metrics-client-ca\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283775 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283634 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-web\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283775 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283665 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283775 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283716 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283775 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283758 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-tls-assets\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283987 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283798 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-config-volume\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283987 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283828 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-config-out\") pod \"c0e63285-299b-4f93-87d1-414e0e418010\" (UID: \"c0e63285-299b-4f93-87d1-414e0e418010\") " Jun 02 15:13:14.283987 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.283853 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:13:14.284135 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.284102 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-main-db\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.284478 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.284452 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:14.286735 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.286690 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:14.286834 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.286808 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:14.287769 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.287723 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-kube-api-access-vzsqv" (OuterVolumeSpecName: "kube-api-access-vzsqv") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "kube-api-access-vzsqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:13:14.287769 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.287730 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:14.287944 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.287809 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:13:14.288006 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.287959 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-config-out" (OuterVolumeSpecName: "config-out") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:13:14.288330 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.288303 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-config-volume" (OuterVolumeSpecName: "config-volume") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:14.288806 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.288781 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:14.288806 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.288795 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:14.288987 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.288943 2575 scope.go:117] "RemoveContainer" containerID="e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17" Jun 02 15:13:14.289246 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:14.289224 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17\": container with ID starting with e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17 not found: ID does not exist" containerID="e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17" Jun 02 15:13:14.289332 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.289256 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17"} err="failed to get container status \"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17\": rpc error: code = NotFound desc = could not find container \"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17\": container with ID starting with e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17 not found: ID does not exist" Jun 02 15:13:14.289332 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.289280 2575 scope.go:117] "RemoveContainer" containerID="356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a" Jun 02 15:13:14.289540 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:14.289517 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a\": container with ID starting with 356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a not found: ID does not exist" containerID="356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a" Jun 02 15:13:14.289605 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.289550 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a"} err="failed to get container status \"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a\": rpc error: code = NotFound desc = could not find container \"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a\": container with ID starting with 356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a not found: ID does not exist" Jun 02 15:13:14.289605 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.289571 2575 scope.go:117] "RemoveContainer" containerID="68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445" Jun 02 15:13:14.289863 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:14.289848 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445\": container with ID starting with 68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445 not found: ID does not exist" containerID="68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445" Jun 02 15:13:14.289931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.289868 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445"} err="failed to get container status \"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445\": rpc error: code = NotFound desc = could not find container \"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445\": container with ID starting with 68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445 not found: ID does not exist" Jun 02 15:13:14.289931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.289887 2575 scope.go:117] "RemoveContainer" containerID="754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d" Jun 02 15:13:14.290139 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:14.290114 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d\": container with ID starting with 754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d not found: ID does not exist" containerID="754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d" Jun 02 15:13:14.290254 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.290138 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d"} err="failed to get container status \"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d\": rpc error: code = NotFound desc = could not find container \"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d\": container with ID starting with 754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d not found: ID does not exist" Jun 02 15:13:14.290254 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.290152 2575 scope.go:117] "RemoveContainer" containerID="636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa" Jun 02 15:13:14.290508 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:14.290490 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa\": container with ID starting with 636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa not found: ID does not exist" containerID="636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa" Jun 02 15:13:14.290565 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.290512 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa"} err="failed to get container status \"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa\": rpc error: code = NotFound desc = could not find container \"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa\": container with ID starting with 636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa not found: ID does not exist" Jun 02 15:13:14.290565 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.290525 2575 scope.go:117] "RemoveContainer" containerID="590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418" Jun 02 15:13:14.290784 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:14.290759 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418\": container with ID starting with 590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418 not found: ID does not exist" containerID="590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418" Jun 02 15:13:14.290852 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.290792 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418"} err="failed to get container status \"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418\": rpc error: code = NotFound desc = could not find container \"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418\": container with ID starting with 590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418 not found: ID does not exist" Jun 02 15:13:14.290852 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.290811 2575 scope.go:117] "RemoveContainer" containerID="26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a" Jun 02 15:13:14.291102 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:14.291075 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a\": container with ID starting with 26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a not found: ID does not exist" containerID="26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a" Jun 02 15:13:14.291203 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291104 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a"} err="failed to get container status \"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a\": rpc error: code = NotFound desc = could not find container \"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a\": container with ID starting with 26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a not found: ID does not exist" Jun 02 15:13:14.291203 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291124 2575 scope.go:117] "RemoveContainer" containerID="e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17" Jun 02 15:13:14.291203 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291130 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:14.291457 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291438 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17"} err="failed to get container status \"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17\": rpc error: code = NotFound desc = could not find container \"e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17\": container with ID starting with e92fd015c511eb8436548de34bd6b91fc625151386122acc0c58f6f66a0a7f17 not found: ID does not exist" Jun 02 15:13:14.291537 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291459 2575 scope.go:117] "RemoveContainer" containerID="356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a" Jun 02 15:13:14.291762 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291676 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a"} err="failed to get container status \"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a\": rpc error: code = NotFound desc = could not find container \"356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a\": container with ID starting with 356f6b95d8df39999adaf7ab4124a6ac27da6baff0976b0d4cc40e65357d309a not found: ID does not exist" Jun 02 15:13:14.291762 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291695 2575 scope.go:117] "RemoveContainer" containerID="68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445" Jun 02 15:13:14.292004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291917 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445"} err="failed to get container status \"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445\": rpc error: code = NotFound desc = could not find container \"68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445\": container with ID starting with 68a2e9ab24f6c1fa0c0734ce7e851d9c0f30c2b812950890ed07c77d3f3d0445 not found: ID does not exist" Jun 02 15:13:14.292004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.291941 2575 scope.go:117] "RemoveContainer" containerID="754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d" Jun 02 15:13:14.292217 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.292147 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d"} err="failed to get container status \"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d\": rpc error: code = NotFound desc = could not find container \"754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d\": container with ID starting with 754c0c0c11737b85e915591114da1acabf271995915a55b7ed9c4ff0615b081d not found: ID does not exist" Jun 02 15:13:14.292217 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.292186 2575 scope.go:117] "RemoveContainer" containerID="636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa" Jun 02 15:13:14.292471 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.292446 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa"} err="failed to get container status \"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa\": rpc error: code = NotFound desc = could not find container \"636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa\": container with ID starting with 636cd9c597fdae8f32876be74d339d09ec089b5ad80153d64bac6624d57857fa not found: ID does not exist" Jun 02 15:13:14.292471 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.292473 2575 scope.go:117] "RemoveContainer" containerID="590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418" Jun 02 15:13:14.292729 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.292697 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418"} err="failed to get container status \"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418\": rpc error: code = NotFound desc = could not find container \"590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418\": container with ID starting with 590e838618c5a972e734120d23b441d4d15169ee9c25a29c2a2851fd35c11418 not found: ID does not exist" Jun 02 15:13:14.292729 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.292724 2575 scope.go:117] "RemoveContainer" containerID="26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a" Jun 02 15:13:14.293001 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.292973 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a"} err="failed to get container status \"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a\": rpc error: code = NotFound desc = could not find container \"26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a\": container with ID starting with 26298982e7dfbd3fabd1f41ba3f188772d7c3df19194a97005a524286074554a not found: ID does not exist" Jun 02 15:13:14.297289 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.297271 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-web-config" (OuterVolumeSpecName: "web-config") pod "c0e63285-299b-4f93-87d1-414e0e418010" (UID: "c0e63285-299b-4f93-87d1-414e0e418010"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:14.384702 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384681 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-main-tls\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384702 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384700 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-cluster-tls-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384709 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzsqv\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-kube-api-access-vzsqv\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384719 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384728 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-web-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384737 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-metrics-client-ca\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384746 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384755 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384764 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0e63285-299b-4f93-87d1-414e0e418010-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384773 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0e63285-299b-4f93-87d1-414e0e418010-tls-assets\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384781 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0e63285-299b-4f93-87d1-414e0e418010-config-volume\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.384813 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.384789 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0e63285-299b-4f93-87d1-414e0e418010-config-out\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:14.569731 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.569708 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:13:14.574313 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.574293 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:13:14.585450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.585423 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0e63285-299b-4f93-87d1-414e0e418010" path="/var/lib/kubelet/pods/c0e63285-299b-4f93-87d1-414e0e418010/volumes" Jun 02 15:13:14.602343 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602324 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:13:14.602547 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602537 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5eeea32-adc4-453d-bc3b-19fbca31a5d5" containerName="console" Jun 02 15:13:14.602588 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602549 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5eeea32-adc4-453d-bc3b-19fbca31a5d5" containerName="console" Jun 02 15:13:14.602588 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602556 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="init-config-reloader" Jun 02 15:13:14.602588 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602562 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="init-config-reloader" Jun 02 15:13:14.602588 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602568 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="alertmanager" Jun 02 15:13:14.602588 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602574 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="alertmanager" Jun 02 15:13:14.602588 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602585 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-metric" Jun 02 15:13:14.602588 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602590 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-metric" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602596 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="prom-label-proxy" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602601 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="prom-label-proxy" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602608 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-web" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602613 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-web" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602622 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602628 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602634 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="config-reloader" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602639 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="config-reloader" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602647 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae170e73-17bb-4217-85df-9e8e7c4843b5" containerName="registry" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602652 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae170e73-17bb-4217-85df-9e8e7c4843b5" containerName="registry" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602688 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="config-reloader" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602696 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="alertmanager" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602701 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae170e73-17bb-4217-85df-9e8e7c4843b5" containerName="registry" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602708 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602715 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5eeea32-adc4-453d-bc3b-19fbca31a5d5" containerName="console" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602720 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="prom-label-proxy" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602726 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-metric" Jun 02 15:13:14.602785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.602732 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0e63285-299b-4f93-87d1-414e0e418010" containerName="kube-rbac-proxy-web" Jun 02 15:13:14.606363 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.606349 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.609497 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.609479 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7phsr\"" Jun 02 15:13:14.609611 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.609507 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 15:13:14.609690 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.609634 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 15:13:14.610137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.609972 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 15:13:14.610137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.609990 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 15:13:14.610137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.610019 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 15:13:14.610137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.610026 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 15:13:14.610137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.610038 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 15:13:14.610137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.610054 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 15:13:14.614933 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.614913 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 15:13:14.621121 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.621099 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:13:14.787716 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-web-config\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.787857 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-config-out\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.787857 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.787857 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.787857 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.787982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.788021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24d97\" (UniqueName: \"kubernetes.io/projected/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-kube-api-access-24d97\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.788054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788299 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.788084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788299 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.788113 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.788299 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.788143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889232 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889158 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889232 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889205 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889395 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889242 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24d97\" (UniqueName: \"kubernetes.io/projected/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-kube-api-access-24d97\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889395 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889271 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889395 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889311 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889429 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889474 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889505 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-web-config\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889536 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-config-out\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889564 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889591 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889648 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.889799 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.889682 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.890272 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.890250 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.890547 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.890525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.890834 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.890811 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.892191 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.892154 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.892461 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.892438 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-config-out\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.892686 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.892665 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.892889 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.892866 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.892889 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.892873 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.893021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.892923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.893021 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.892976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.893283 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.893262 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-web-config\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.894014 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.893997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.897909 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.897892 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24d97\" (UniqueName: \"kubernetes.io/projected/0c32f72f-736d-47bd-b1ad-cc2b38b40ad5-kube-api-access-24d97\") pod \"alertmanager-main-0\" (UID: \"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:14.914776 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:14.914761 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:13:15.050026 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:15.049606 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:13:15.053054 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:13:15.053025 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c32f72f_736d_47bd_b1ad_cc2b38b40ad5.slice/crio-a98d360a8277f7bf2673b793562fc10c62c59b6035600dc1ff489fca04246a3e WatchSource:0}: Error finding container a98d360a8277f7bf2673b793562fc10c62c59b6035600dc1ff489fca04246a3e: Status 404 returned error can't find the container with id a98d360a8277f7bf2673b793562fc10c62c59b6035600dc1ff489fca04246a3e Jun 02 15:13:15.248790 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:15.248727 2575 generic.go:358] "Generic (PLEG): container finished" podID="0c32f72f-736d-47bd-b1ad-cc2b38b40ad5" containerID="aa9cc0cf4b08c761af8043f6263f91336bc9f431386043e67233d7fb20ae4076" exitCode=0 Jun 02 15:13:15.249132 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:15.248793 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerDied","Data":"aa9cc0cf4b08c761af8043f6263f91336bc9f431386043e67233d7fb20ae4076"} Jun 02 15:13:15.249132 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:15.248834 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerStarted","Data":"a98d360a8277f7bf2673b793562fc10c62c59b6035600dc1ff489fca04246a3e"} Jun 02 15:13:16.253954 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:16.253878 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerStarted","Data":"fb874e877570584ff9c728a41c70adb8a6c6cb89975672b8c7794de6ea58c96e"} Jun 02 15:13:16.253954 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:16.253910 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerStarted","Data":"476dfc43f5dd33bd5f34188c89e29736d78e638f4f96e8df4c5b199757b8b1c5"} Jun 02 15:13:16.253954 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:16.253920 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerStarted","Data":"3cbbe7a9bb8cc6c4ed192618598b83fa1281639d2da7278cf7ab4f0bc454e945"} Jun 02 15:13:16.253954 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:16.253928 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerStarted","Data":"37f1ee1a18e8078ec4ead77e6f599431d70ce39174bc7ed8e4d4711b9c5fb8f3"} Jun 02 15:13:16.253954 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:16.253937 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerStarted","Data":"183a143b4dc8fad9e3d7dd0c94d6eeb5efa0ea8ffe52694717501f5b5308d6b5"} Jun 02 15:13:16.253954 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:16.253946 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c32f72f-736d-47bd-b1ad-cc2b38b40ad5","Type":"ContainerStarted","Data":"1ee213c671e77bc4968782c557eee6df7723c4b05c9e580a6fb2d0e5ba1b106c"} Jun 02 15:13:16.288111 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:16.288061 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.288045586 podStartE2EDuration="2.288045586s" podCreationTimestamp="2026-06-02 15:13:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:13:16.287239579 +0000 UTC m=+242.275869432" watchObservedRunningTime="2026-06-02 15:13:16.288045586 +0000 UTC m=+242.276675441" Jun 02 15:13:17.183866 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.183832 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:13:17.184326 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.184288 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="prometheus" containerID="cri-o://b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" gracePeriod=600 Jun 02 15:13:17.184326 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.184317 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="config-reloader" containerID="cri-o://b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" gracePeriod=600 Jun 02 15:13:17.184520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.184334 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy" containerID="cri-o://075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" gracePeriod=600 Jun 02 15:13:17.184520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.184352 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="thanos-sidecar" containerID="cri-o://923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" gracePeriod=600 Jun 02 15:13:17.184520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.184382 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" gracePeriod=600 Jun 02 15:13:17.184520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.184311 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-web" containerID="cri-o://69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" gracePeriod=600 Jun 02 15:13:17.519005 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.518983 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:17.614307 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614274 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-kube-rbac-proxy\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614323 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config-out\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614341 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-metrics-client-ca\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614450 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614358 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-tls\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614489 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-kubelet-serving-ca-bundle\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614528 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-grpc-tls\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614570 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-metrics-client-certs\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614604 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614637 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-web-config\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614664 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614690 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-rulefiles-0\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.614749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614718 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-db\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.615004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614767 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.615004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614794 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-serving-certs-ca-bundle\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.615004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614825 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-thanos-prometheus-http-client-file\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.615004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614827 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:17.615004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614857 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-tls-assets\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.615004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614888 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjqbt\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-kube-api-access-bjqbt\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.615004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.614912 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-trusted-ca-bundle\") pod \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\" (UID: \"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf\") " Jun 02 15:13:17.615400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.615051 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:17.615400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.615191 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-metrics-client-ca\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.615400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.615213 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.615903 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.615639 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:17.617214 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.617165 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:17.617329 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.617279 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.617389 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.617324 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.617389 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.617376 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config-out" (OuterVolumeSpecName: "config-out") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:13:17.617975 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.617944 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:17.618194 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.618135 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.618266 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.618204 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.618473 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.618441 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-kube-api-access-bjqbt" (OuterVolumeSpecName: "kube-api-access-bjqbt") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "kube-api-access-bjqbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:13:17.618767 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.618739 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:13:17.619032 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.619009 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.619445 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.619425 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.619503 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.619449 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.619503 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.619474 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config" (OuterVolumeSpecName: "config") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.619676 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.619661 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:13:17.627994 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.627973 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-web-config" (OuterVolumeSpecName: "web-config") pod "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" (UID: "75f10e2f-3ef8-49cd-aa5d-9f637e962aaf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:17.716564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716477 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716507 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-k8s-db\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716523 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716537 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716549 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716564 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-tls-assets\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716577 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjqbt\" (UniqueName: \"kubernetes.io/projected/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-kube-api-access-bjqbt\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716589 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716604 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-kube-rbac-proxy\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716616 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config-out\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716628 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716640 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-grpc-tls\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716652 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-metrics-client-certs\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716665 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716677 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-web-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:17.716864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:17.716689 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:18.262774 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262732 2575 generic.go:358] "Generic (PLEG): container finished" podID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" exitCode=0 Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262780 2575 generic.go:358] "Generic (PLEG): container finished" podID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" exitCode=0 Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262791 2575 generic.go:358] "Generic (PLEG): container finished" podID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" exitCode=0 Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262800 2575 generic.go:358] "Generic (PLEG): container finished" podID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" exitCode=0 Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262808 2575 generic.go:358] "Generic (PLEG): container finished" podID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" exitCode=0 Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262816 2575 generic.go:358] "Generic (PLEG): container finished" podID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" exitCode=0 Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262869 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262913 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262930 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262946 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262963 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.262985 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} Jun 02 15:13:18.263003 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.263001 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"75f10e2f-3ef8-49cd-aa5d-9f637e962aaf","Type":"ContainerDied","Data":"8cc0c6b4fd70e25d7141113197f02e9401e1e0317e59a5015cba468e760145ca"} Jun 02 15:13:18.263535 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.263027 2575 scope.go:117] "RemoveContainer" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.267336 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.267063 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.275215 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.275191 2575 scope.go:117] "RemoveContainer" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.283880 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.283817 2575 scope.go:117] "RemoveContainer" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.290541 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.290515 2575 scope.go:117] "RemoveContainer" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.292780 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.292754 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:13:18.296618 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.296594 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:13:18.297707 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.297692 2575 scope.go:117] "RemoveContainer" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.303811 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.303794 2575 scope.go:117] "RemoveContainer" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.310127 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.310110 2575 scope.go:117] "RemoveContainer" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.316135 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.316118 2575 scope.go:117] "RemoveContainer" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.316388 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:18.316371 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": container with ID starting with 8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67 not found: ID does not exist" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.316438 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.316398 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} err="failed to get container status \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": rpc error: code = NotFound desc = could not find container \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": container with ID starting with 8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67 not found: ID does not exist" Jun 02 15:13:18.316438 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.316417 2575 scope.go:117] "RemoveContainer" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.316630 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:18.316612 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": container with ID starting with 075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01 not found: ID does not exist" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.316669 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.316637 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} err="failed to get container status \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": rpc error: code = NotFound desc = could not find container \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": container with ID starting with 075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01 not found: ID does not exist" Jun 02 15:13:18.316669 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.316659 2575 scope.go:117] "RemoveContainer" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.316842 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:18.316827 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": container with ID starting with 69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1 not found: ID does not exist" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.316889 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.316846 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} err="failed to get container status \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": rpc error: code = NotFound desc = could not find container \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": container with ID starting with 69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1 not found: ID does not exist" Jun 02 15:13:18.316889 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.316858 2575 scope.go:117] "RemoveContainer" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.317037 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:18.317021 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": container with ID starting with 923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44 not found: ID does not exist" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.317075 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317040 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} err="failed to get container status \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": rpc error: code = NotFound desc = could not find container \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": container with ID starting with 923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44 not found: ID does not exist" Jun 02 15:13:18.317075 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317064 2575 scope.go:117] "RemoveContainer" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.317282 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:18.317260 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": container with ID starting with b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc not found: ID does not exist" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.317343 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317288 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} err="failed to get container status \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": rpc error: code = NotFound desc = could not find container \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": container with ID starting with b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc not found: ID does not exist" Jun 02 15:13:18.317343 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317301 2575 scope.go:117] "RemoveContainer" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.317513 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:18.317492 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": container with ID starting with b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917 not found: ID does not exist" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.317600 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317513 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} err="failed to get container status \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": rpc error: code = NotFound desc = could not find container \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": container with ID starting with b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917 not found: ID does not exist" Jun 02 15:13:18.317600 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317528 2575 scope.go:117] "RemoveContainer" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.317748 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:18.317734 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": container with ID starting with d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2 not found: ID does not exist" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.317785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317751 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2"} err="failed to get container status \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": rpc error: code = NotFound desc = could not find container \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": container with ID starting with d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2 not found: ID does not exist" Jun 02 15:13:18.317785 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317763 2575 scope.go:117] "RemoveContainer" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.317946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317932 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} err="failed to get container status \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": rpc error: code = NotFound desc = could not find container \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": container with ID starting with 8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67 not found: ID does not exist" Jun 02 15:13:18.318036 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.317945 2575 scope.go:117] "RemoveContainer" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.318149 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318133 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} err="failed to get container status \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": rpc error: code = NotFound desc = could not find container \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": container with ID starting with 075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01 not found: ID does not exist" Jun 02 15:13:18.318149 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318147 2575 scope.go:117] "RemoveContainer" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.318324 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318309 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} err="failed to get container status \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": rpc error: code = NotFound desc = could not find container \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": container with ID starting with 69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1 not found: ID does not exist" Jun 02 15:13:18.318324 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318322 2575 scope.go:117] "RemoveContainer" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.318567 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318549 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} err="failed to get container status \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": rpc error: code = NotFound desc = could not find container \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": container with ID starting with 923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44 not found: ID does not exist" Jun 02 15:13:18.318613 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318570 2575 scope.go:117] "RemoveContainer" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.318791 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318773 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} err="failed to get container status \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": rpc error: code = NotFound desc = could not find container \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": container with ID starting with b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc not found: ID does not exist" Jun 02 15:13:18.318845 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318791 2575 scope.go:117] "RemoveContainer" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.318996 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318980 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} err="failed to get container status \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": rpc error: code = NotFound desc = could not find container \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": container with ID starting with b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917 not found: ID does not exist" Jun 02 15:13:18.319041 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.318996 2575 scope.go:117] "RemoveContainer" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.319186 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319155 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2"} err="failed to get container status \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": rpc error: code = NotFound desc = could not find container \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": container with ID starting with d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2 not found: ID does not exist" Jun 02 15:13:18.319240 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319188 2575 scope.go:117] "RemoveContainer" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.319376 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319362 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} err="failed to get container status \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": rpc error: code = NotFound desc = could not find container \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": container with ID starting with 8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67 not found: ID does not exist" Jun 02 15:13:18.319417 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319376 2575 scope.go:117] "RemoveContainer" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.319560 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319544 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} err="failed to get container status \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": rpc error: code = NotFound desc = could not find container \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": container with ID starting with 075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01 not found: ID does not exist" Jun 02 15:13:18.319604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319560 2575 scope.go:117] "RemoveContainer" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.319774 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319756 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} err="failed to get container status \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": rpc error: code = NotFound desc = could not find container \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": container with ID starting with 69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1 not found: ID does not exist" Jun 02 15:13:18.319774 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319774 2575 scope.go:117] "RemoveContainer" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.319961 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319946 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} err="failed to get container status \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": rpc error: code = NotFound desc = could not find container \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": container with ID starting with 923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44 not found: ID does not exist" Jun 02 15:13:18.319998 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.319960 2575 scope.go:117] "RemoveContainer" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.320154 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320138 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} err="failed to get container status \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": rpc error: code = NotFound desc = could not find container \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": container with ID starting with b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc not found: ID does not exist" Jun 02 15:13:18.320259 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320155 2575 scope.go:117] "RemoveContainer" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.320376 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320360 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} err="failed to get container status \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": rpc error: code = NotFound desc = could not find container \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": container with ID starting with b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917 not found: ID does not exist" Jun 02 15:13:18.320413 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320377 2575 scope.go:117] "RemoveContainer" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.320585 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320566 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2"} err="failed to get container status \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": rpc error: code = NotFound desc = could not find container \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": container with ID starting with d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2 not found: ID does not exist" Jun 02 15:13:18.320632 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320585 2575 scope.go:117] "RemoveContainer" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.320761 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320746 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} err="failed to get container status \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": rpc error: code = NotFound desc = could not find container \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": container with ID starting with 8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67 not found: ID does not exist" Jun 02 15:13:18.320805 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320761 2575 scope.go:117] "RemoveContainer" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.320936 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320921 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} err="failed to get container status \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": rpc error: code = NotFound desc = could not find container \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": container with ID starting with 075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01 not found: ID does not exist" Jun 02 15:13:18.320978 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.320937 2575 scope.go:117] "RemoveContainer" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.321098 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321081 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} err="failed to get container status \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": rpc error: code = NotFound desc = could not find container \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": container with ID starting with 69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1 not found: ID does not exist" Jun 02 15:13:18.321140 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321099 2575 scope.go:117] "RemoveContainer" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.321315 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321299 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} err="failed to get container status \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": rpc error: code = NotFound desc = could not find container \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": container with ID starting with 923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44 not found: ID does not exist" Jun 02 15:13:18.321375 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321314 2575 scope.go:117] "RemoveContainer" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.321508 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321488 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} err="failed to get container status \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": rpc error: code = NotFound desc = could not find container \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": container with ID starting with b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc not found: ID does not exist" Jun 02 15:13:18.321555 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321508 2575 scope.go:117] "RemoveContainer" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.321700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321685 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} err="failed to get container status \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": rpc error: code = NotFound desc = could not find container \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": container with ID starting with b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917 not found: ID does not exist" Jun 02 15:13:18.321700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321699 2575 scope.go:117] "RemoveContainer" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.321920 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321903 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2"} err="failed to get container status \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": rpc error: code = NotFound desc = could not find container \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": container with ID starting with d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2 not found: ID does not exist" Jun 02 15:13:18.321966 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.321921 2575 scope.go:117] "RemoveContainer" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.322129 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322114 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} err="failed to get container status \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": rpc error: code = NotFound desc = could not find container \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": container with ID starting with 8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67 not found: ID does not exist" Jun 02 15:13:18.322219 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322129 2575 scope.go:117] "RemoveContainer" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.322417 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322377 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} err="failed to get container status \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": rpc error: code = NotFound desc = could not find container \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": container with ID starting with 075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01 not found: ID does not exist" Jun 02 15:13:18.322417 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322392 2575 scope.go:117] "RemoveContainer" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.322688 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322666 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} err="failed to get container status \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": rpc error: code = NotFound desc = could not find container \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": container with ID starting with 69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1 not found: ID does not exist" Jun 02 15:13:18.322743 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322690 2575 scope.go:117] "RemoveContainer" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.323027 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322934 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} err="failed to get container status \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": rpc error: code = NotFound desc = could not find container \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": container with ID starting with 923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44 not found: ID does not exist" Jun 02 15:13:18.323027 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.322963 2575 scope.go:117] "RemoveContainer" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.323276 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323251 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} err="failed to get container status \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": rpc error: code = NotFound desc = could not find container \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": container with ID starting with b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc not found: ID does not exist" Jun 02 15:13:18.323276 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323269 2575 scope.go:117] "RemoveContainer" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.323520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323487 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} err="failed to get container status \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": rpc error: code = NotFound desc = could not find container \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": container with ID starting with b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917 not found: ID does not exist" Jun 02 15:13:18.323596 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323522 2575 scope.go:117] "RemoveContainer" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.323773 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323754 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2"} err="failed to get container status \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": rpc error: code = NotFound desc = could not find container \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": container with ID starting with d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2 not found: ID does not exist" Jun 02 15:13:18.323816 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323774 2575 scope.go:117] "RemoveContainer" containerID="8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67" Jun 02 15:13:18.323983 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323957 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67"} err="failed to get container status \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": rpc error: code = NotFound desc = could not find container \"8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67\": container with ID starting with 8b35cc27d2e471aa5e15a2f181d4ee842e823cf947ea0a5f9e43a1b4203d1b67 not found: ID does not exist" Jun 02 15:13:18.324034 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.323983 2575 scope.go:117] "RemoveContainer" containerID="075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01" Jun 02 15:13:18.324206 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324185 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01"} err="failed to get container status \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": rpc error: code = NotFound desc = could not find container \"075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01\": container with ID starting with 075743bea4f1b38aff3dbb166155788d8f4ffe4c72ea215f105c4102dfc30e01 not found: ID does not exist" Jun 02 15:13:18.324254 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324208 2575 scope.go:117] "RemoveContainer" containerID="69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1" Jun 02 15:13:18.324423 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324406 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1"} err="failed to get container status \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": rpc error: code = NotFound desc = could not find container \"69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1\": container with ID starting with 69665d11e8defb6df7bbaef1eedad6e179cc6d2e3ade11a2de12880aeaa789c1 not found: ID does not exist" Jun 02 15:13:18.324466 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324423 2575 scope.go:117] "RemoveContainer" containerID="923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44" Jun 02 15:13:18.324517 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324503 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:13:18.324664 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324646 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44"} err="failed to get container status \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": rpc error: code = NotFound desc = could not find container \"923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44\": container with ID starting with 923b1e23de5b51b291847cbffa10f66fe97ef5485ac1d5540e9f380630ad6c44 not found: ID does not exist" Jun 02 15:13:18.324718 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324666 2575 scope.go:117] "RemoveContainer" containerID="b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc" Jun 02 15:13:18.324809 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324795 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="init-config-reloader" Jun 02 15:13:18.324849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324813 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="init-config-reloader" Jun 02 15:13:18.324849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324824 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-thanos" Jun 02 15:13:18.324849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324834 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-thanos" Jun 02 15:13:18.324849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324847 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="config-reloader" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324853 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="config-reloader" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324860 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324870 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324881 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="prometheus" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324886 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="prometheus" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324894 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="thanos-sidecar" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324899 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="thanos-sidecar" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324905 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-web" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324910 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-web" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324855 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc"} err="failed to get container status \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": rpc error: code = NotFound desc = could not find container \"b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc\": container with ID starting with b986b0d064800bb62e729e5723c793be91e788334974b282a6217d8b643f58fc not found: ID does not exist" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324942 2575 scope.go:117] "RemoveContainer" containerID="b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324950 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="prometheus" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324958 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-web" Jun 02 15:13:18.324962 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324965 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy" Jun 02 15:13:18.325456 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324972 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="config-reloader" Jun 02 15:13:18.325456 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324979 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="thanos-sidecar" Jun 02 15:13:18.325456 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.324985 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" containerName="kube-rbac-proxy-thanos" Jun 02 15:13:18.325456 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.325124 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917"} err="failed to get container status \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": rpc error: code = NotFound desc = could not find container \"b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917\": container with ID starting with b661e9b2fbcbcbdfb7cf2e1820a0dd5fa92ed97db22ded26a06cfeb854429917 not found: ID does not exist" Jun 02 15:13:18.325456 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.325139 2575 scope.go:117] "RemoveContainer" containerID="d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2" Jun 02 15:13:18.325456 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.325375 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2"} err="failed to get container status \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": rpc error: code = NotFound desc = could not find container \"d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2\": container with ID starting with d967b8ef11638379a725fa63ab05931581320bc5c1e218ccb78149cfc08c37b2 not found: ID does not exist" Jun 02 15:13:18.328665 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.328650 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.331593 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331572 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 15:13:18.331705 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331656 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 15:13:18.331705 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331682 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-237drhrjuktg3\"" Jun 02 15:13:18.331705 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331695 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 15:13:18.331905 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331886 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 15:13:18.331905 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331902 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l6mng\"" Jun 02 15:13:18.331905 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331935 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 15:13:18.331905 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.331946 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 15:13:18.332303 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.332284 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 15:13:18.332388 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.332286 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 15:13:18.332388 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.332292 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 15:13:18.333053 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.333038 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 15:13:18.335145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.335122 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 15:13:18.337718 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.337701 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 15:13:18.342997 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.342975 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:13:18.421755 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.421893 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421761 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.421893 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.421893 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsm8b\" (UniqueName: \"kubernetes.io/projected/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-kube-api-access-lsm8b\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.421893 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422064 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422064 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422064 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422064 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.421993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422064 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422016 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422242 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422242 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422242 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422242 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422242 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-config\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422242 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422419 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.422419 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.422301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.523533 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.523533 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523492 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.523533 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523510 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.523533 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523535 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsm8b\" (UniqueName: \"kubernetes.io/projected/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-kube-api-access-lsm8b\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524050 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523560 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524050 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524050 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523681 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524050 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523866 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524050 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.523906 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524362 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524336 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524425 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524395 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524425 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524409 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524551 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524460 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524551 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524489 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524551 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524523 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524555 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524584 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-config\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524615 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524650 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.524901 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524715 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.526797 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.526720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.526911 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.526874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.526911 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.526891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.526911 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.524464 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.527204 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.527161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.527295 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.527209 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.527295 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.527233 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.527295 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.527263 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.527882 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.527857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.527993 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.527973 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.528391 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.528371 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.528930 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.528910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.529335 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.529316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-config\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.529807 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.529782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.530375 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.530355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.531781 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.531761 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsm8b\" (UniqueName: \"kubernetes.io/projected/c5f4a8ad-5ab2-4a02-8684-eecf46de9552-kube-api-access-lsm8b\") pod \"prometheus-k8s-0\" (UID: \"c5f4a8ad-5ab2-4a02-8684-eecf46de9552\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.586213 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.586158 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f10e2f-3ef8-49cd-aa5d-9f637e962aaf" path="/var/lib/kubelet/pods/75f10e2f-3ef8-49cd-aa5d-9f637e962aaf/volumes" Jun 02 15:13:18.639678 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.639652 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:18.772611 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:18.772548 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:13:18.775109 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:13:18.775039 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f4a8ad_5ab2_4a02_8684_eecf46de9552.slice/crio-9a8e5d28737e1e050b8206e697db8b11ab7c3bf06639d5c93836c2dcdd157a04 WatchSource:0}: Error finding container 9a8e5d28737e1e050b8206e697db8b11ab7c3bf06639d5c93836c2dcdd157a04: Status 404 returned error can't find the container with id 9a8e5d28737e1e050b8206e697db8b11ab7c3bf06639d5c93836c2dcdd157a04 Jun 02 15:13:19.266841 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:19.266809 2575 generic.go:358] "Generic (PLEG): container finished" podID="c5f4a8ad-5ab2-4a02-8684-eecf46de9552" containerID="cff3f003b7d02a3b8ac32776a591968b46b40311c2513fd158c18e7ff80319ac" exitCode=0 Jun 02 15:13:19.267002 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:19.266865 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerDied","Data":"cff3f003b7d02a3b8ac32776a591968b46b40311c2513fd158c18e7ff80319ac"} Jun 02 15:13:19.267002 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:19.266883 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerStarted","Data":"9a8e5d28737e1e050b8206e697db8b11ab7c3bf06639d5c93836c2dcdd157a04"} Jun 02 15:13:20.273270 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:20.273240 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerStarted","Data":"3fb3c9f916557d71cc4250c224d722a2fbca5a8088cdda8ebcf3d8675e09526d"} Jun 02 15:13:20.273270 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:20.273273 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerStarted","Data":"67b1e304e9117cf794985e6beb103ea788f4a07a2f9dc7dece84951ffd770a20"} Jun 02 15:13:20.273636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:20.273282 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerStarted","Data":"8629f8aac73ce55799a5380e3869cdc146f2ed9a2875f019f50d0b25e75b2199"} Jun 02 15:13:20.273636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:20.273291 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerStarted","Data":"b27a7207e979f542af6d88a9c32bcf84e6553e922c832b86e0c324b488af2931"} Jun 02 15:13:20.273636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:20.273300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerStarted","Data":"a0e1af96cd10ae42841118a60edbfffac273dd96585eb74a45a524027a286508"} Jun 02 15:13:20.273636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:20.273307 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f4a8ad-5ab2-4a02-8684-eecf46de9552","Type":"ContainerStarted","Data":"db5831a7c6e0b35697bdb21cc5cc3b320cc9fd68433e81692bbf1fad4bef4708"} Jun 02 15:13:20.311975 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:20.311930 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.3119166939999998 podStartE2EDuration="2.311916694s" podCreationTimestamp="2026-06-02 15:13:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:13:20.310556959 +0000 UTC m=+246.299186823" watchObservedRunningTime="2026-06-02 15:13:20.311916694 +0000 UTC m=+246.300546547" Jun 02 15:13:23.640046 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:23.640014 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:13:26.389617 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:26.389573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:13:26.391883 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:26.391861 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75b890ed-1d05-439e-984d-61d35ed04b3b-metrics-certs\") pod \"network-metrics-daemon-9gfmq\" (UID: \"75b890ed-1d05-439e-984d-61d35ed04b3b\") " pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:13:26.486917 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:26.486886 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fnhpd\"" Jun 02 15:13:26.494977 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:26.494957 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gfmq" Jun 02 15:13:26.615395 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:26.615332 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9gfmq"] Jun 02 15:13:26.617525 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:13:26.617500 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b890ed_1d05_439e_984d_61d35ed04b3b.slice/crio-73663e0137bd8fab6af23cc0a640461a1305ba9aaa33367341a7baf8a479de48 WatchSource:0}: Error finding container 73663e0137bd8fab6af23cc0a640461a1305ba9aaa33367341a7baf8a479de48: Status 404 returned error can't find the container with id 73663e0137bd8fab6af23cc0a640461a1305ba9aaa33367341a7baf8a479de48 Jun 02 15:13:27.292881 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:27.292839 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gfmq" event={"ID":"75b890ed-1d05-439e-984d-61d35ed04b3b","Type":"ContainerStarted","Data":"73663e0137bd8fab6af23cc0a640461a1305ba9aaa33367341a7baf8a479de48"} Jun 02 15:13:29.301692 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:29.301647 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gfmq" event={"ID":"75b890ed-1d05-439e-984d-61d35ed04b3b","Type":"ContainerStarted","Data":"9c616c69b6b08ddee5c60f7079013a3ec2ab6973c45582966e9af116f943bc55"} Jun 02 15:13:29.302080 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:29.301699 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gfmq" event={"ID":"75b890ed-1d05-439e-984d-61d35ed04b3b","Type":"ContainerStarted","Data":"ca75c8961ca444c3758cfe8b76905267d331c1f2d18bfdf156a435ce1f2599b5"} Jun 02 15:13:29.320514 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:29.320467 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9gfmq" podStartSLOduration=253.010426265 podStartE2EDuration="4m15.320454079s" podCreationTimestamp="2026-06-02 15:09:14 +0000 UTC" firstStartedPulling="2026-06-02 15:13:26.619264433 +0000 UTC m=+252.607894263" lastFinishedPulling="2026-06-02 15:13:28.929292232 +0000 UTC m=+254.917922077" observedRunningTime="2026-06-02 15:13:29.318824877 +0000 UTC m=+255.307454732" watchObservedRunningTime="2026-06-02 15:13:29.320454079 +0000 UTC m=+255.309083929" Jun 02 15:13:33.010270 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:33.010189 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7874b6d9b6-lscvq"] Jun 02 15:13:58.031350 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.031296 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7874b6d9b6-lscvq" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerName="console" containerID="cri-o://0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c" gracePeriod=15 Jun 02 15:13:58.125255 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.125224 2575 patch_prober.go:28] interesting pod/console-7874b6d9b6-lscvq container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jun 02 15:13:58.125364 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.125271 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7874b6d9b6-lscvq" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jun 02 15:13:58.270494 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.270472 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7874b6d9b6-lscvq_0c5c5b05-0872-462c-aece-1d3c0d6a4008/console/0.log" Jun 02 15:13:58.270597 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.270536 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:13:58.355489 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355433 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzg8q\" (UniqueName: \"kubernetes.io/projected/0c5c5b05-0872-462c-aece-1d3c0d6a4008-kube-api-access-tzg8q\") pod \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " Jun 02 15:13:58.355489 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355484 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-config\") pod \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " Jun 02 15:13:58.355629 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355506 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-oauth-serving-cert\") pod \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " Jun 02 15:13:58.355629 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355537 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-service-ca\") pod \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " Jun 02 15:13:58.355629 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355586 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-oauth-config\") pod \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " Jun 02 15:13:58.355749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355635 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-trusted-ca-bundle\") pod \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " Jun 02 15:13:58.355749 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355658 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-serving-cert\") pod \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\" (UID: \"0c5c5b05-0872-462c-aece-1d3c0d6a4008\") " Jun 02 15:13:58.355885 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355858 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-config" (OuterVolumeSpecName: "console-config") pod "0c5c5b05-0872-462c-aece-1d3c0d6a4008" (UID: "0c5c5b05-0872-462c-aece-1d3c0d6a4008"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:58.355991 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355960 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c5c5b05-0872-462c-aece-1d3c0d6a4008" (UID: "0c5c5b05-0872-462c-aece-1d3c0d6a4008"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:58.356067 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.355972 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c5c5b05-0872-462c-aece-1d3c0d6a4008" (UID: "0c5c5b05-0872-462c-aece-1d3c0d6a4008"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:58.356122 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.356090 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c5c5b05-0872-462c-aece-1d3c0d6a4008" (UID: "0c5c5b05-0872-462c-aece-1d3c0d6a4008"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:13:58.357602 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.357580 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5c5b05-0872-462c-aece-1d3c0d6a4008-kube-api-access-tzg8q" (OuterVolumeSpecName: "kube-api-access-tzg8q") pod "0c5c5b05-0872-462c-aece-1d3c0d6a4008" (UID: "0c5c5b05-0872-462c-aece-1d3c0d6a4008"). InnerVolumeSpecName "kube-api-access-tzg8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:13:58.357602 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.357592 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c5c5b05-0872-462c-aece-1d3c0d6a4008" (UID: "0c5c5b05-0872-462c-aece-1d3c0d6a4008"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:58.357739 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.357702 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c5c5b05-0872-462c-aece-1d3c0d6a4008" (UID: "0c5c5b05-0872-462c-aece-1d3c0d6a4008"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:13:58.383630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.383612 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7874b6d9b6-lscvq_0c5c5b05-0872-462c-aece-1d3c0d6a4008/console/0.log" Jun 02 15:13:58.383716 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.383647 2575 generic.go:358] "Generic (PLEG): container finished" podID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerID="0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c" exitCode=2 Jun 02 15:13:58.383716 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.383700 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7874b6d9b6-lscvq" Jun 02 15:13:58.383824 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.383737 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7874b6d9b6-lscvq" event={"ID":"0c5c5b05-0872-462c-aece-1d3c0d6a4008","Type":"ContainerDied","Data":"0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c"} Jun 02 15:13:58.383824 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.383777 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7874b6d9b6-lscvq" event={"ID":"0c5c5b05-0872-462c-aece-1d3c0d6a4008","Type":"ContainerDied","Data":"56dda0de259583b23e0b234516037b7a14e64ccb76595c0cf712c5a8b1628aa8"} Jun 02 15:13:58.383824 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.383798 2575 scope.go:117] "RemoveContainer" containerID="0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c" Jun 02 15:13:58.391728 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.391708 2575 scope.go:117] "RemoveContainer" containerID="0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c" Jun 02 15:13:58.391963 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:13:58.391945 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c\": container with ID starting with 0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c not found: ID does not exist" containerID="0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c" Jun 02 15:13:58.392008 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.391969 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c"} err="failed to get container status \"0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c\": rpc error: code = NotFound desc = could not find container \"0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c\": container with ID starting with 0e2bff7531df1829a98a28716e330187bc728671365d30c4ff36667a8488b25c not found: ID does not exist" Jun 02 15:13:58.405177 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.405145 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7874b6d9b6-lscvq"] Jun 02 15:13:58.409519 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.409500 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7874b6d9b6-lscvq"] Jun 02 15:13:58.456549 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.456532 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-trusted-ca-bundle\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:58.456621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.456550 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-serving-cert\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:58.456621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.456561 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzg8q\" (UniqueName: \"kubernetes.io/projected/0c5c5b05-0872-462c-aece-1d3c0d6a4008-kube-api-access-tzg8q\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:58.456621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.456583 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:58.456621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.456592 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-oauth-serving-cert\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:58.456621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.456601 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c5b05-0872-462c-aece-1d3c0d6a4008-service-ca\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:58.456621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.456610 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5c5b05-0872-462c-aece-1d3c0d6a4008-console-oauth-config\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:13:58.586327 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:13:58.586304 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" path="/var/lib/kubelet/pods/0c5c5b05-0872-462c-aece-1d3c0d6a4008/volumes" Jun 02 15:14:14.466454 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:14:14.462245 2575 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 15:14:18.640163 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:14:18.640131 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:14:18.654944 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:14:18.654922 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:14:19.456369 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:14:19.456344 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:16:14.570892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.570863 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-8cbbb"] Jun 02 15:16:14.571287 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.571117 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerName="console" Jun 02 15:16:14.571287 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.571128 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerName="console" Jun 02 15:16:14.571287 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.571190 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c5c5b05-0872-462c-aece-1d3c0d6a4008" containerName="console" Jun 02 15:16:14.572872 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.572854 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:14.576041 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.576021 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5t7sq\"" Jun 02 15:16:14.577024 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.577008 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 15:16:14.577127 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.577111 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 15:16:14.587324 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.587301 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-8cbbb"] Jun 02 15:16:14.614486 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.614464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgmq7\" (UniqueName: \"kubernetes.io/projected/3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1-kube-api-access-vgmq7\") pod \"cert-manager-webhook-587ccfb98-8cbbb\" (UID: \"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:14.614594 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.614578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-8cbbb\" (UID: \"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:14.715313 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.715287 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-8cbbb\" (UID: \"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:14.715445 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.715333 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgmq7\" (UniqueName: \"kubernetes.io/projected/3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1-kube-api-access-vgmq7\") pod \"cert-manager-webhook-587ccfb98-8cbbb\" (UID: \"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:14.729947 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.729926 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgmq7\" (UniqueName: \"kubernetes.io/projected/3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1-kube-api-access-vgmq7\") pod \"cert-manager-webhook-587ccfb98-8cbbb\" (UID: \"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:14.730124 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.730104 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-8cbbb\" (UID: \"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:14.891065 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:14.890998 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:15.013654 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:15.013624 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-8cbbb"] Jun 02 15:16:15.016572 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:16:15.016541 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3be802b6_4b7f_47c9_b9cb_ffa0418e3eb1.slice/crio-399786a7396a1c47ac0f55c43db299ab4301e07f022d8af9989363dec8c82cb9 WatchSource:0}: Error finding container 399786a7396a1c47ac0f55c43db299ab4301e07f022d8af9989363dec8c82cb9: Status 404 returned error can't find the container with id 399786a7396a1c47ac0f55c43db299ab4301e07f022d8af9989363dec8c82cb9 Jun 02 15:16:15.018636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:15.018613 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:16:15.740924 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:15.740891 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" event={"ID":"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1","Type":"ContainerStarted","Data":"399786a7396a1c47ac0f55c43db299ab4301e07f022d8af9989363dec8c82cb9"} Jun 02 15:16:18.751668 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:18.751632 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" event={"ID":"3be802b6-4b7f-47c9-b9cb-ffa0418e3eb1","Type":"ContainerStarted","Data":"c5af114120239348bc22e3d41ac396f73fc7042c96161a0fa85f5e238335c7db"} Jun 02 15:16:18.752010 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:18.751743 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:18.770635 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:18.770587 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" podStartSLOduration=1.204641852 podStartE2EDuration="4.770575071s" podCreationTimestamp="2026-06-02 15:16:14 +0000 UTC" firstStartedPulling="2026-06-02 15:16:15.018739762 +0000 UTC m=+421.007369596" lastFinishedPulling="2026-06-02 15:16:18.584672981 +0000 UTC m=+424.573302815" observedRunningTime="2026-06-02 15:16:18.769492742 +0000 UTC m=+424.758122599" watchObservedRunningTime="2026-06-02 15:16:18.770575071 +0000 UTC m=+424.759204924" Jun 02 15:16:24.631915 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.631881 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf"] Jun 02 15:16:24.634332 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.634319 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:24.637057 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.637037 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vrc6z\"" Jun 02 15:16:24.637153 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.637063 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 15:16:24.637992 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.637978 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:16:24.642511 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.642487 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf"] Jun 02 15:16:24.687981 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.687961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83319a6a-db1d-4c8b-abb6-eed6e24fb500-tmp\") pod \"openshift-lws-operator-bfc7f696d-hvhwf\" (UID: \"83319a6a-db1d-4c8b-abb6-eed6e24fb500\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:24.688088 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.688009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswxc\" (UniqueName: \"kubernetes.io/projected/83319a6a-db1d-4c8b-abb6-eed6e24fb500-kube-api-access-dswxc\") pod \"openshift-lws-operator-bfc7f696d-hvhwf\" (UID: \"83319a6a-db1d-4c8b-abb6-eed6e24fb500\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:24.757909 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.757892 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-8cbbb" Jun 02 15:16:24.788987 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.788967 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dswxc\" (UniqueName: \"kubernetes.io/projected/83319a6a-db1d-4c8b-abb6-eed6e24fb500-kube-api-access-dswxc\") pod \"openshift-lws-operator-bfc7f696d-hvhwf\" (UID: \"83319a6a-db1d-4c8b-abb6-eed6e24fb500\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:24.789104 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.789036 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83319a6a-db1d-4c8b-abb6-eed6e24fb500-tmp\") pod \"openshift-lws-operator-bfc7f696d-hvhwf\" (UID: \"83319a6a-db1d-4c8b-abb6-eed6e24fb500\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:24.789524 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.789499 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83319a6a-db1d-4c8b-abb6-eed6e24fb500-tmp\") pod \"openshift-lws-operator-bfc7f696d-hvhwf\" (UID: \"83319a6a-db1d-4c8b-abb6-eed6e24fb500\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:24.798272 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.798245 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswxc\" (UniqueName: \"kubernetes.io/projected/83319a6a-db1d-4c8b-abb6-eed6e24fb500-kube-api-access-dswxc\") pod \"openshift-lws-operator-bfc7f696d-hvhwf\" (UID: \"83319a6a-db1d-4c8b-abb6-eed6e24fb500\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:24.943632 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:24.943562 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" Jun 02 15:16:25.066324 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:25.066297 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf"] Jun 02 15:16:25.068649 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:16:25.068622 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83319a6a_db1d_4c8b_abb6_eed6e24fb500.slice/crio-09a0ff415b2d9501934a9d957b664f21e8069d885bcb2e29dc35c6f26afbca29 WatchSource:0}: Error finding container 09a0ff415b2d9501934a9d957b664f21e8069d885bcb2e29dc35c6f26afbca29: Status 404 returned error can't find the container with id 09a0ff415b2d9501934a9d957b664f21e8069d885bcb2e29dc35c6f26afbca29 Jun 02 15:16:25.774901 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:25.774870 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" event={"ID":"83319a6a-db1d-4c8b-abb6-eed6e24fb500","Type":"ContainerStarted","Data":"09a0ff415b2d9501934a9d957b664f21e8069d885bcb2e29dc35c6f26afbca29"} Jun 02 15:16:37.808216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:37.808178 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" event={"ID":"83319a6a-db1d-4c8b-abb6-eed6e24fb500","Type":"ContainerStarted","Data":"88452f0922249e289ed83eca250e2db6a6eb91b846f824b984bb4ba4ed205d8f"} Jun 02 15:16:37.827449 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:37.827405 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvhwf" podStartSLOduration=1.6405289060000001 podStartE2EDuration="13.82739274s" podCreationTimestamp="2026-06-02 15:16:24 +0000 UTC" firstStartedPulling="2026-06-02 15:16:25.070019399 +0000 UTC m=+431.058649230" lastFinishedPulling="2026-06-02 15:16:37.256883231 +0000 UTC m=+443.245513064" observedRunningTime="2026-06-02 15:16:37.826331024 +0000 UTC m=+443.814960879" watchObservedRunningTime="2026-06-02 15:16:37.82739274 +0000 UTC m=+443.816022592" Jun 02 15:16:48.759779 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.759742 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj"] Jun 02 15:16:48.762298 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.762277 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.775347 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.775329 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 15:16:48.776135 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.776122 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 15:16:48.776210 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.776189 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 15:16:48.777098 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.777083 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m98rs\"" Jun 02 15:16:48.807991 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.807966 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj"] Jun 02 15:16:48.868152 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.868123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-metrics-cert\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.868276 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.868206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-cert\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.868276 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.868248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-manager-config\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.868388 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.868330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blcdw\" (UniqueName: \"kubernetes.io/projected/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-kube-api-access-blcdw\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.969686 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.969647 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-cert\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.969822 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.969696 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-manager-config\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.969822 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.969729 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blcdw\" (UniqueName: \"kubernetes.io/projected/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-kube-api-access-blcdw\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.969822 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.969757 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-metrics-cert\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.970418 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.970396 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-manager-config\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.972153 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.972128 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-cert\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.972256 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.972190 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-metrics-cert\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:48.981668 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:48.981647 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blcdw\" (UniqueName: \"kubernetes.io/projected/4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b-kube-api-access-blcdw\") pod \"lws-controller-manager-cfd44ccff-s8qrj\" (UID: \"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b\") " pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:49.070802 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:49.070780 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:49.203636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:49.203603 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj"] Jun 02 15:16:49.206715 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:16:49.206688 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3632c4_fa8a_4b01_90e5_ba4e6d837e2b.slice/crio-87d17b74201632f19ef99f9dc10ef26ce1e34d591709f85ccb98e19c1362c6a2 WatchSource:0}: Error finding container 87d17b74201632f19ef99f9dc10ef26ce1e34d591709f85ccb98e19c1362c6a2: Status 404 returned error can't find the container with id 87d17b74201632f19ef99f9dc10ef26ce1e34d591709f85ccb98e19c1362c6a2 Jun 02 15:16:49.839941 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:49.839904 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" event={"ID":"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b","Type":"ContainerStarted","Data":"87d17b74201632f19ef99f9dc10ef26ce1e34d591709f85ccb98e19c1362c6a2"} Jun 02 15:16:50.843897 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:50.843865 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" event={"ID":"4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b","Type":"ContainerStarted","Data":"7420ae88d11dc7745eb4de327e51fc8dd7f879372d0f19a28d061be4a107eebf"} Jun 02 15:16:50.844344 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:50.844000 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:16:50.876090 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:50.876043 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" podStartSLOduration=1.5655632640000001 podStartE2EDuration="2.876028744s" podCreationTimestamp="2026-06-02 15:16:48 +0000 UTC" firstStartedPulling="2026-06-02 15:16:49.208434171 +0000 UTC m=+455.197064002" lastFinishedPulling="2026-06-02 15:16:50.518899634 +0000 UTC m=+456.507529482" observedRunningTime="2026-06-02 15:16:50.873889346 +0000 UTC m=+456.862519210" watchObservedRunningTime="2026-06-02 15:16:50.876028744 +0000 UTC m=+456.864658596" Jun 02 15:16:53.591145 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.591114 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w"] Jun 02 15:16:53.595689 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.595672 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.599372 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.599351 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 15:16:53.600085 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.600066 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 15:16:53.600198 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.600096 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 15:16:53.600198 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.600096 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 15:16:53.605261 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.605245 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hpv82\"" Jun 02 15:16:53.610830 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.610806 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w"] Jun 02 15:16:53.708442 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.708417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e868aff3-5b4d-4f47-b664-7aebda66bf5d-tmp\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.708442 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.708446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e868aff3-5b4d-4f47-b664-7aebda66bf5d-manifests\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.708622 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.708500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e868aff3-5b4d-4f47-b664-7aebda66bf5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.708622 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.708555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e868aff3-5b4d-4f47-b664-7aebda66bf5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.708721 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.708648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2mb8\" (UniqueName: \"kubernetes.io/projected/e868aff3-5b4d-4f47-b664-7aebda66bf5d-kube-api-access-r2mb8\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.809879 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.809849 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e868aff3-5b4d-4f47-b664-7aebda66bf5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.810004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.809903 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2mb8\" (UniqueName: \"kubernetes.io/projected/e868aff3-5b4d-4f47-b664-7aebda66bf5d-kube-api-access-r2mb8\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.810004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.809967 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e868aff3-5b4d-4f47-b664-7aebda66bf5d-tmp\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.810004 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.809996 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e868aff3-5b4d-4f47-b664-7aebda66bf5d-manifests\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.810206 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.810028 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e868aff3-5b4d-4f47-b664-7aebda66bf5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.810433 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.810405 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e868aff3-5b4d-4f47-b664-7aebda66bf5d-manifests\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.812032 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.812011 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e868aff3-5b4d-4f47-b664-7aebda66bf5d-tmp\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.812282 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.812262 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e868aff3-5b4d-4f47-b664-7aebda66bf5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.812453 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.812435 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e868aff3-5b4d-4f47-b664-7aebda66bf5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.820647 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.820621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2mb8\" (UniqueName: \"kubernetes.io/projected/e868aff3-5b4d-4f47-b664-7aebda66bf5d-kube-api-access-r2mb8\") pod \"opendatahub-operator-controller-manager-5889c5df7b-l8w7w\" (UID: \"e868aff3-5b4d-4f47-b664-7aebda66bf5d\") " pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:53.904931 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:53.904877 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:54.049602 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:54.049567 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w"] Jun 02 15:16:54.057692 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:16:54.057670 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode868aff3_5b4d_4f47_b664_7aebda66bf5d.slice/crio-456f4ed13aef356e0a87fbbdbf780c8813c633f797bc08f8c1e5aa897da670ff WatchSource:0}: Error finding container 456f4ed13aef356e0a87fbbdbf780c8813c633f797bc08f8c1e5aa897da670ff: Status 404 returned error can't find the container with id 456f4ed13aef356e0a87fbbdbf780c8813c633f797bc08f8c1e5aa897da670ff Jun 02 15:16:54.856181 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:54.856095 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" event={"ID":"e868aff3-5b4d-4f47-b664-7aebda66bf5d","Type":"ContainerStarted","Data":"456f4ed13aef356e0a87fbbdbf780c8813c633f797bc08f8c1e5aa897da670ff"} Jun 02 15:16:57.868687 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:57.868641 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" event={"ID":"e868aff3-5b4d-4f47-b664-7aebda66bf5d","Type":"ContainerStarted","Data":"4e170517e230423279cc917cc049c84f8b17d23af6aca94cc63a38b170d143ce"} Jun 02 15:16:58.872347 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:58.872312 2575 generic.go:358] "Generic (PLEG): container finished" podID="e868aff3-5b4d-4f47-b664-7aebda66bf5d" containerID="4e170517e230423279cc917cc049c84f8b17d23af6aca94cc63a38b170d143ce" exitCode=0 Jun 02 15:16:58.872714 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:58.872398 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" event={"ID":"e868aff3-5b4d-4f47-b664-7aebda66bf5d","Type":"ContainerDied","Data":"4e170517e230423279cc917cc049c84f8b17d23af6aca94cc63a38b170d143ce"} Jun 02 15:16:59.877084 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:59.877048 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" event={"ID":"e868aff3-5b4d-4f47-b664-7aebda66bf5d","Type":"ContainerStarted","Data":"ef7fe4ac3e1f00eadb33e7f2d9c2a383fd0fcdc13c12124562937f479903313a"} Jun 02 15:16:59.877518 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:59.877205 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:16:59.900732 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:16:59.900672 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" podStartSLOduration=1.720156379 podStartE2EDuration="6.900651486s" podCreationTimestamp="2026-06-02 15:16:53 +0000 UTC" firstStartedPulling="2026-06-02 15:16:54.0594442 +0000 UTC m=+460.048074034" lastFinishedPulling="2026-06-02 15:16:59.239939302 +0000 UTC m=+465.228569141" observedRunningTime="2026-06-02 15:16:59.899339551 +0000 UTC m=+465.887969405" watchObservedRunningTime="2026-06-02 15:16:59.900651486 +0000 UTC m=+465.889281414" Jun 02 15:17:01.848559 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:01.848530 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cfd44ccff-s8qrj" Jun 02 15:17:10.882358 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:10.882322 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5889c5df7b-l8w7w" Jun 02 15:17:13.828522 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.828489 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx"] Jun 02 15:17:13.830671 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.830655 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:13.834748 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.834729 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 15:17:13.835587 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.835567 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7z496\"" Jun 02 15:17:13.836531 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.836512 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 15:17:13.881081 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.881055 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx"] Jun 02 15:17:13.964584 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.964555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2j58\" (UniqueName: \"kubernetes.io/projected/2b9855e2-9c7b-484f-9286-42dd14936c8a-kube-api-access-m2j58\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:13.964720 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.964592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b9855e2-9c7b-484f-9286-42dd14936c8a-tls-certs\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:13.964720 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:13.964644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9855e2-9c7b-484f-9286-42dd14936c8a-tmp\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.065368 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.065339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9855e2-9c7b-484f-9286-42dd14936c8a-tmp\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.065510 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.065403 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2j58\" (UniqueName: \"kubernetes.io/projected/2b9855e2-9c7b-484f-9286-42dd14936c8a-kube-api-access-m2j58\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.065510 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.065438 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b9855e2-9c7b-484f-9286-42dd14936c8a-tls-certs\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.067769 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.067745 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9855e2-9c7b-484f-9286-42dd14936c8a-tmp\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.067990 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.067969 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b9855e2-9c7b-484f-9286-42dd14936c8a-tls-certs\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.089203 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.089126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2j58\" (UniqueName: \"kubernetes.io/projected/2b9855e2-9c7b-484f-9286-42dd14936c8a-kube-api-access-m2j58\") pod \"kube-auth-proxy-85c6f598cb-77vmx\" (UID: \"2b9855e2-9c7b-484f-9286-42dd14936c8a\") " pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.140488 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.140464 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" Jun 02 15:17:14.317646 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.317615 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx"] Jun 02 15:17:14.322554 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:17:14.322528 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9855e2_9c7b_484f_9286_42dd14936c8a.slice/crio-e8e199d8095c581d084a1fa6cb411a6fc2256f560d5771aa719b1027a182966e WatchSource:0}: Error finding container e8e199d8095c581d084a1fa6cb411a6fc2256f560d5771aa719b1027a182966e: Status 404 returned error can't find the container with id e8e199d8095c581d084a1fa6cb411a6fc2256f560d5771aa719b1027a182966e Jun 02 15:17:14.928415 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:14.928383 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" event={"ID":"2b9855e2-9c7b-484f-9286-42dd14936c8a","Type":"ContainerStarted","Data":"e8e199d8095c581d084a1fa6cb411a6fc2256f560d5771aa719b1027a182966e"} Jun 02 15:17:18.246057 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:18.246031 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 15:17:18.942283 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:18.942246 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" event={"ID":"2b9855e2-9c7b-484f-9286-42dd14936c8a","Type":"ContainerStarted","Data":"fa98304f36871872dee6bd009c1fb802d086a6ac68cabd28cf823c2a2e79755d"} Jun 02 15:17:18.962786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:17:18.962738 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85c6f598cb-77vmx" podStartSLOduration=2.04373027 podStartE2EDuration="5.962725766s" podCreationTimestamp="2026-06-02 15:17:13 +0000 UTC" firstStartedPulling="2026-06-02 15:17:14.324232875 +0000 UTC m=+480.312862720" lastFinishedPulling="2026-06-02 15:17:18.243228385 +0000 UTC m=+484.231858216" observedRunningTime="2026-06-02 15:17:18.961664221 +0000 UTC m=+484.950294076" watchObservedRunningTime="2026-06-02 15:17:18.962725766 +0000 UTC m=+484.951355620" Jun 02 15:18:53.292291 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.292253 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb"] Jun 02 15:18:53.294821 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.294800 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.297500 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.297476 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 15:18:53.298564 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.298545 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 15:18:53.298665 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.298544 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b2wlh\"" Jun 02 15:18:53.298665 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.298599 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 15:18:53.298665 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.298609 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 15:18:53.306079 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.306058 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb"] Jun 02 15:18:53.332023 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.331994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mfmq\" (UniqueName: \"kubernetes.io/projected/cf33ebb8-632e-4f0c-823a-49387638805b-kube-api-access-6mfmq\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.332120 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.332035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf33ebb8-632e-4f0c-823a-49387638805b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.332165 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.332141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf33ebb8-632e-4f0c-823a-49387638805b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.432479 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.432459 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf33ebb8-632e-4f0c-823a-49387638805b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.432558 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.432505 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf33ebb8-632e-4f0c-823a-49387638805b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.432558 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.432544 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfmq\" (UniqueName: \"kubernetes.io/projected/cf33ebb8-632e-4f0c-823a-49387638805b-kube-api-access-6mfmq\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.432699 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:18:53.432683 2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 02 15:18:53.432763 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:18:53.432752 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf33ebb8-632e-4f0c-823a-49387638805b-plugin-serving-cert podName:cf33ebb8-632e-4f0c-823a-49387638805b nodeName:}" failed. No retries permitted until 2026-06-02 15:18:53.932731082 +0000 UTC m=+579.921360930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/cf33ebb8-632e-4f0c-823a-49387638805b-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-ncdrb" (UID: "cf33ebb8-632e-4f0c-823a-49387638805b") : secret "plugin-serving-cert" not found Jun 02 15:18:53.433069 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.433052 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf33ebb8-632e-4f0c-823a-49387638805b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.446662 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.446639 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfmq\" (UniqueName: \"kubernetes.io/projected/cf33ebb8-632e-4f0c-823a-49387638805b-kube-api-access-6mfmq\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.936976 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.936944 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf33ebb8-632e-4f0c-823a-49387638805b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:53.939282 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:53.939255 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf33ebb8-632e-4f0c-823a-49387638805b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ncdrb\" (UID: \"cf33ebb8-632e-4f0c-823a-49387638805b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:54.204315 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:54.204241 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" Jun 02 15:18:54.328595 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:54.328570 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb"] Jun 02 15:18:54.330629 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:18:54.330597 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf33ebb8_632e_4f0c_823a_49387638805b.slice/crio-dd4b40fea5a0e3d0f1a3121cf0a2744c6e778cda44ea18010a2182aca22911ef WatchSource:0}: Error finding container dd4b40fea5a0e3d0f1a3121cf0a2744c6e778cda44ea18010a2182aca22911ef: Status 404 returned error can't find the container with id dd4b40fea5a0e3d0f1a3121cf0a2744c6e778cda44ea18010a2182aca22911ef Jun 02 15:18:55.233840 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:18:55.233799 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" event={"ID":"cf33ebb8-632e-4f0c-823a-49387638805b","Type":"ContainerStarted","Data":"dd4b40fea5a0e3d0f1a3121cf0a2744c6e778cda44ea18010a2182aca22911ef"} Jun 02 15:19:19.325684 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:19.325652 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" event={"ID":"cf33ebb8-632e-4f0c-823a-49387638805b","Type":"ContainerStarted","Data":"5fe0457ed1526cf90efbad6aa7911f5524b75fcf5795fc3b122eb32072f6307e"} Jun 02 15:19:19.341984 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:19.341926 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ncdrb" podStartSLOduration=1.7283914280000001 podStartE2EDuration="26.341910991s" podCreationTimestamp="2026-06-02 15:18:53 +0000 UTC" firstStartedPulling="2026-06-02 15:18:54.331900423 +0000 UTC m=+580.320530254" lastFinishedPulling="2026-06-02 15:19:18.945419974 +0000 UTC m=+604.934049817" observedRunningTime="2026-06-02 15:19:19.341492043 +0000 UTC m=+605.330121896" watchObservedRunningTime="2026-06-02 15:19:19.341910991 +0000 UTC m=+605.330540844" Jun 02 15:19:49.361077 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.361041 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfsj2"] Jun 02 15:19:49.380857 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.380828 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfsj2"] Jun 02 15:19:49.380994 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.380940 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.383834 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.383816 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 15:19:49.467193 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.467141 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfsj2"] Jun 02 15:19:49.493984 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.493954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-config-file\") pod \"limitador-limitador-7d549b5b-sfsj2\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.494124 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.494106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhbdh\" (UniqueName: \"kubernetes.io/projected/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-kube-api-access-fhbdh\") pod \"limitador-limitador-7d549b5b-sfsj2\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.594781 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.594753 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhbdh\" (UniqueName: \"kubernetes.io/projected/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-kube-api-access-fhbdh\") pod \"limitador-limitador-7d549b5b-sfsj2\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.594923 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.594794 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-config-file\") pod \"limitador-limitador-7d549b5b-sfsj2\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.595331 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.595314 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-config-file\") pod \"limitador-limitador-7d549b5b-sfsj2\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.602932 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.602900 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhbdh\" (UniqueName: \"kubernetes.io/projected/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-kube-api-access-fhbdh\") pod \"limitador-limitador-7d549b5b-sfsj2\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.690953 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.690897 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:49.809822 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:49.809804 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfsj2"] Jun 02 15:19:49.812576 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:19:49.812545 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27db3a41_3b7f_40d7_8ffd_cb66e66a2938.slice/crio-4a8e13b69c3c125d43d662dbc681cff001a294824de5282cbba6d560adcb8b90 WatchSource:0}: Error finding container 4a8e13b69c3c125d43d662dbc681cff001a294824de5282cbba6d560adcb8b90: Status 404 returned error can't find the container with id 4a8e13b69c3c125d43d662dbc681cff001a294824de5282cbba6d560adcb8b90 Jun 02 15:19:50.348536 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.348507 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-t9dtj"] Jun 02 15:19:50.351333 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.351316 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t9dtj" Jun 02 15:19:50.355801 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.355769 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kzp72\"" Jun 02 15:19:50.361419 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.361397 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-t9dtj"] Jun 02 15:19:50.402898 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.402871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9f4\" (UniqueName: \"kubernetes.io/projected/87d1eb09-fe44-4d58-9c96-e35d5f595964-kube-api-access-6h9f4\") pod \"authorino-7498df8756-t9dtj\" (UID: \"87d1eb09-fe44-4d58-9c96-e35d5f595964\") " pod="kuadrant-system/authorino-7498df8756-t9dtj" Jun 02 15:19:50.423727 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.423697 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" event={"ID":"27db3a41-3b7f-40d7-8ffd-cb66e66a2938","Type":"ContainerStarted","Data":"4a8e13b69c3c125d43d662dbc681cff001a294824de5282cbba6d560adcb8b90"} Jun 02 15:19:50.504264 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.504237 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9f4\" (UniqueName: \"kubernetes.io/projected/87d1eb09-fe44-4d58-9c96-e35d5f595964-kube-api-access-6h9f4\") pod \"authorino-7498df8756-t9dtj\" (UID: \"87d1eb09-fe44-4d58-9c96-e35d5f595964\") " pod="kuadrant-system/authorino-7498df8756-t9dtj" Jun 02 15:19:50.516410 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.516383 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9f4\" (UniqueName: \"kubernetes.io/projected/87d1eb09-fe44-4d58-9c96-e35d5f595964-kube-api-access-6h9f4\") pod \"authorino-7498df8756-t9dtj\" (UID: \"87d1eb09-fe44-4d58-9c96-e35d5f595964\") " pod="kuadrant-system/authorino-7498df8756-t9dtj" Jun 02 15:19:50.661103 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.661018 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t9dtj" Jun 02 15:19:50.830838 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:50.830642 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-t9dtj"] Jun 02 15:19:50.834341 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:19:50.834288 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87d1eb09_fe44_4d58_9c96_e35d5f595964.slice/crio-dd2b1e58a83d438cc3680955de20d97a61bff7b7e1a93c0c8b3bd361d8efe681 WatchSource:0}: Error finding container dd2b1e58a83d438cc3680955de20d97a61bff7b7e1a93c0c8b3bd361d8efe681: Status 404 returned error can't find the container with id dd2b1e58a83d438cc3680955de20d97a61bff7b7e1a93c0c8b3bd361d8efe681 Jun 02 15:19:51.428629 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:51.428591 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t9dtj" event={"ID":"87d1eb09-fe44-4d58-9c96-e35d5f595964","Type":"ContainerStarted","Data":"dd2b1e58a83d438cc3680955de20d97a61bff7b7e1a93c0c8b3bd361d8efe681"} Jun 02 15:19:53.438137 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:53.438096 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" event={"ID":"27db3a41-3b7f-40d7-8ffd-cb66e66a2938","Type":"ContainerStarted","Data":"b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba"} Jun 02 15:19:53.438621 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:53.438221 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:19:53.459446 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:53.459390 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" podStartSLOduration=1.710205993 podStartE2EDuration="4.459373311s" podCreationTimestamp="2026-06-02 15:19:49 +0000 UTC" firstStartedPulling="2026-06-02 15:19:49.814298227 +0000 UTC m=+635.802928062" lastFinishedPulling="2026-06-02 15:19:52.563465532 +0000 UTC m=+638.552095380" observedRunningTime="2026-06-02 15:19:53.45901261 +0000 UTC m=+639.447642461" watchObservedRunningTime="2026-06-02 15:19:53.459373311 +0000 UTC m=+639.448003205" Jun 02 15:19:55.445855 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:55.445814 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t9dtj" event={"ID":"87d1eb09-fe44-4d58-9c96-e35d5f595964","Type":"ContainerStarted","Data":"cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32"} Jun 02 15:19:55.462724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:19:55.462681 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-t9dtj" podStartSLOduration=1.840990318 podStartE2EDuration="5.462668518s" podCreationTimestamp="2026-06-02 15:19:50 +0000 UTC" firstStartedPulling="2026-06-02 15:19:50.836364032 +0000 UTC m=+636.824993881" lastFinishedPulling="2026-06-02 15:19:54.458042247 +0000 UTC m=+640.446672081" observedRunningTime="2026-06-02 15:19:55.461235822 +0000 UTC m=+641.449865678" watchObservedRunningTime="2026-06-02 15:19:55.462668518 +0000 UTC m=+641.451298370" Jun 02 15:20:04.272857 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.272815 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfsj2"] Jun 02 15:20:04.273284 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.273104 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" podUID="27db3a41-3b7f-40d7-8ffd-cb66e66a2938" containerName="limitador" containerID="cri-o://b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba" gracePeriod=30 Jun 02 15:20:04.273793 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.273771 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:20:04.809274 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.809253 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:20:04.926452 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.926379 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhbdh\" (UniqueName: \"kubernetes.io/projected/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-kube-api-access-fhbdh\") pod \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " Jun 02 15:20:04.926452 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.926417 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-config-file\") pod \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\" (UID: \"27db3a41-3b7f-40d7-8ffd-cb66e66a2938\") " Jun 02 15:20:04.926800 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.926779 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-config-file" (OuterVolumeSpecName: "config-file") pod "27db3a41-3b7f-40d7-8ffd-cb66e66a2938" (UID: "27db3a41-3b7f-40d7-8ffd-cb66e66a2938"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:20:04.928474 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:04.928451 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-kube-api-access-fhbdh" (OuterVolumeSpecName: "kube-api-access-fhbdh") pod "27db3a41-3b7f-40d7-8ffd-cb66e66a2938" (UID: "27db3a41-3b7f-40d7-8ffd-cb66e66a2938"). InnerVolumeSpecName "kube-api-access-fhbdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:20:05.027842 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.027805 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhbdh\" (UniqueName: \"kubernetes.io/projected/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-kube-api-access-fhbdh\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:20:05.027842 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.027840 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27db3a41-3b7f-40d7-8ffd-cb66e66a2938-config-file\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:20:05.478643 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.478611 2575 generic.go:358] "Generic (PLEG): container finished" podID="27db3a41-3b7f-40d7-8ffd-cb66e66a2938" containerID="b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba" exitCode=0 Jun 02 15:20:05.479094 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.478674 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" Jun 02 15:20:05.479094 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.478688 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" event={"ID":"27db3a41-3b7f-40d7-8ffd-cb66e66a2938","Type":"ContainerDied","Data":"b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba"} Jun 02 15:20:05.479094 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.478724 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfsj2" event={"ID":"27db3a41-3b7f-40d7-8ffd-cb66e66a2938","Type":"ContainerDied","Data":"4a8e13b69c3c125d43d662dbc681cff001a294824de5282cbba6d560adcb8b90"} Jun 02 15:20:05.479094 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.478746 2575 scope.go:117] "RemoveContainer" containerID="b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba" Jun 02 15:20:05.486604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.486584 2575 scope.go:117] "RemoveContainer" containerID="b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba" Jun 02 15:20:05.486850 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:20:05.486833 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba\": container with ID starting with b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba not found: ID does not exist" containerID="b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba" Jun 02 15:20:05.486910 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.486858 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba"} err="failed to get container status \"b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba\": rpc error: code = NotFound desc = could not find container \"b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba\": container with ID starting with b665908ed7efcd0efe493e06c5922e1d3aabdbe4eae0830117dc5da5058885ba not found: ID does not exist" Jun 02 15:20:05.498727 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.498707 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfsj2"] Jun 02 15:20:05.502777 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:05.502748 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfsj2"] Jun 02 15:20:06.586507 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.586476 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27db3a41-3b7f-40d7-8ffd-cb66e66a2938" path="/var/lib/kubelet/pods/27db3a41-3b7f-40d7-8ffd-cb66e66a2938/volumes" Jun 02 15:20:06.915476 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.915399 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-w86z7"] Jun 02 15:20:06.915700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.915684 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27db3a41-3b7f-40d7-8ffd-cb66e66a2938" containerName="limitador" Jun 02 15:20:06.915746 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.915703 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="27db3a41-3b7f-40d7-8ffd-cb66e66a2938" containerName="limitador" Jun 02 15:20:06.915778 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.915773 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="27db3a41-3b7f-40d7-8ffd-cb66e66a2938" containerName="limitador" Jun 02 15:20:06.918275 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.918251 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:06.921046 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.921023 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 15:20:06.921140 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.921065 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4b2vj\"" Jun 02 15:20:06.927742 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:06.927721 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-w86z7"] Jun 02 15:20:07.045636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.045603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2395a0b3-3205-4af6-80f1-a7d526569b94-data\") pod \"postgres-68c4fbbd6f-w86z7\" (UID: \"2395a0b3-3205-4af6-80f1-a7d526569b94\") " pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:07.045786 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.045665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngnv\" (UniqueName: \"kubernetes.io/projected/2395a0b3-3205-4af6-80f1-a7d526569b94-kube-api-access-mngnv\") pod \"postgres-68c4fbbd6f-w86z7\" (UID: \"2395a0b3-3205-4af6-80f1-a7d526569b94\") " pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:07.146891 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.146862 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mngnv\" (UniqueName: \"kubernetes.io/projected/2395a0b3-3205-4af6-80f1-a7d526569b94-kube-api-access-mngnv\") pod \"postgres-68c4fbbd6f-w86z7\" (UID: \"2395a0b3-3205-4af6-80f1-a7d526569b94\") " pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:07.147013 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.146911 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2395a0b3-3205-4af6-80f1-a7d526569b94-data\") pod \"postgres-68c4fbbd6f-w86z7\" (UID: \"2395a0b3-3205-4af6-80f1-a7d526569b94\") " pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:07.147255 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.147239 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2395a0b3-3205-4af6-80f1-a7d526569b94-data\") pod \"postgres-68c4fbbd6f-w86z7\" (UID: \"2395a0b3-3205-4af6-80f1-a7d526569b94\") " pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:07.155165 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.155144 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngnv\" (UniqueName: \"kubernetes.io/projected/2395a0b3-3205-4af6-80f1-a7d526569b94-kube-api-access-mngnv\") pod \"postgres-68c4fbbd6f-w86z7\" (UID: \"2395a0b3-3205-4af6-80f1-a7d526569b94\") " pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:07.230691 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.230613 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:07.352807 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.352770 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-w86z7"] Jun 02 15:20:07.357438 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:20:07.357408 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2395a0b3_3205_4af6_80f1_a7d526569b94.slice/crio-8530bfc7c2f611687025a80a7ff59dc8c2f713ee745af105a45e04462d433548 WatchSource:0}: Error finding container 8530bfc7c2f611687025a80a7ff59dc8c2f713ee745af105a45e04462d433548: Status 404 returned error can't find the container with id 8530bfc7c2f611687025a80a7ff59dc8c2f713ee745af105a45e04462d433548 Jun 02 15:20:07.487826 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:07.487760 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-w86z7" event={"ID":"2395a0b3-3205-4af6-80f1-a7d526569b94","Type":"ContainerStarted","Data":"8530bfc7c2f611687025a80a7ff59dc8c2f713ee745af105a45e04462d433548"} Jun 02 15:20:10.499557 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:10.499527 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-w86z7" event={"ID":"2395a0b3-3205-4af6-80f1-a7d526569b94","Type":"ContainerStarted","Data":"7e8b81617f4c0083f5528d5fb473e7eb7ecdf2d191307b209c54b6ac249953a3"} Jun 02 15:20:10.499925 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:10.499637 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:10.519155 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:10.519102 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-w86z7" podStartSLOduration=2.15345211 podStartE2EDuration="4.519090596s" podCreationTimestamp="2026-06-02 15:20:06 +0000 UTC" firstStartedPulling="2026-06-02 15:20:07.358637394 +0000 UTC m=+653.347267226" lastFinishedPulling="2026-06-02 15:20:09.724275879 +0000 UTC m=+655.712905712" observedRunningTime="2026-06-02 15:20:10.517792016 +0000 UTC m=+656.506421869" watchObservedRunningTime="2026-06-02 15:20:10.519090596 +0000 UTC m=+656.507720449" Jun 02 15:20:16.535233 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:16.535200 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-w86z7" Jun 02 15:20:42.343830 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.343795 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:20:42.346350 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.346330 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:20:42.349419 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.349387 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 15:20:42.349419 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.349416 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 15:20:42.349603 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.349430 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 15:20:42.350630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.350608 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wnxp5\"" Jun 02 15:20:42.356446 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.356417 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:20:42.422682 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.422654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxj2\" (UniqueName: \"kubernetes.io/projected/4c91e31d-6e56-46e5-9804-03bd6d9379dc-kube-api-access-vjxj2\") pod \"maas-keycloak-0\" (UID: \"4c91e31d-6e56-46e5-9804-03bd6d9379dc\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:20:42.523674 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.523650 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxj2\" (UniqueName: \"kubernetes.io/projected/4c91e31d-6e56-46e5-9804-03bd6d9379dc-kube-api-access-vjxj2\") pod \"maas-keycloak-0\" (UID: \"4c91e31d-6e56-46e5-9804-03bd6d9379dc\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:20:42.531483 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.531457 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxj2\" (UniqueName: \"kubernetes.io/projected/4c91e31d-6e56-46e5-9804-03bd6d9379dc-kube-api-access-vjxj2\") pod \"maas-keycloak-0\" (UID: \"4c91e31d-6e56-46e5-9804-03bd6d9379dc\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:20:42.656522 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.656446 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:20:42.783836 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:42.783807 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:20:42.786717 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:20:42.786686 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c91e31d_6e56_46e5_9804_03bd6d9379dc.slice/crio-73f5fd9d3b5df60342e9edb1f3f29565fd4035448174d9177dd5d3958380cd7e WatchSource:0}: Error finding container 73f5fd9d3b5df60342e9edb1f3f29565fd4035448174d9177dd5d3958380cd7e: Status 404 returned error can't find the container with id 73f5fd9d3b5df60342e9edb1f3f29565fd4035448174d9177dd5d3958380cd7e Jun 02 15:20:43.601632 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:43.601589 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c91e31d-6e56-46e5-9804-03bd6d9379dc","Type":"ContainerStarted","Data":"73f5fd9d3b5df60342e9edb1f3f29565fd4035448174d9177dd5d3958380cd7e"} Jun 02 15:20:49.622484 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:49.622439 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c91e31d-6e56-46e5-9804-03bd6d9379dc","Type":"ContainerStarted","Data":"f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043"} Jun 02 15:20:49.642132 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:49.642077 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6643235299999999 podStartE2EDuration="7.642062372s" podCreationTimestamp="2026-06-02 15:20:42 +0000 UTC" firstStartedPulling="2026-06-02 15:20:42.787806024 +0000 UTC m=+688.776435856" lastFinishedPulling="2026-06-02 15:20:48.765544868 +0000 UTC m=+694.754174698" observedRunningTime="2026-06-02 15:20:49.64027788 +0000 UTC m=+695.628907734" watchObservedRunningTime="2026-06-02 15:20:49.642062372 +0000 UTC m=+695.630692225" Jun 02 15:20:49.657491 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:49.657452 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 15:20:49.658930 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:49.658898 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:50.658001 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:50.657938 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:51.657257 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:51.657207 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:52.656928 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:52.656888 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:20:52.657846 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:52.657812 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:53.657744 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:53.657689 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:54.656941 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:54.656882 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:55.656980 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:55.656935 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:56.661291 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:56.661242 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:57.656849 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:57.656803 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:58.657371 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:58.657320 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:20:59.657151 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:20:59.657106 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:21:00.656924 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:00.656876 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 15:21:01.777091 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:01.777047 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 15:21:01.793205 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:01.793121 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:21:11.783538 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:11.783503 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:21:13.024797 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.024763 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-745776dfd6-9kf8k"] Jun 02 15:21:13.030805 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.030776 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.033796 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.033778 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 15:21:13.040519 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.040500 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-745776dfd6-9kf8k"] Jun 02 15:21:13.119961 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.119938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/622841f6-83ac-4fe1-b7de-2a95068beee2-tls-cert\") pod \"authorino-745776dfd6-9kf8k\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.120060 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.120003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l4g5\" (UniqueName: \"kubernetes.io/projected/622841f6-83ac-4fe1-b7de-2a95068beee2-kube-api-access-2l4g5\") pod \"authorino-745776dfd6-9kf8k\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.220638 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.220612 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/622841f6-83ac-4fe1-b7de-2a95068beee2-tls-cert\") pod \"authorino-745776dfd6-9kf8k\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.220765 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.220718 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l4g5\" (UniqueName: \"kubernetes.io/projected/622841f6-83ac-4fe1-b7de-2a95068beee2-kube-api-access-2l4g5\") pod \"authorino-745776dfd6-9kf8k\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.223245 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.223219 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/622841f6-83ac-4fe1-b7de-2a95068beee2-tls-cert\") pod \"authorino-745776dfd6-9kf8k\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.229159 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.229136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l4g5\" (UniqueName: \"kubernetes.io/projected/622841f6-83ac-4fe1-b7de-2a95068beee2-kube-api-access-2l4g5\") pod \"authorino-745776dfd6-9kf8k\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.339482 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.339453 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:21:13.464132 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.464105 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-745776dfd6-9kf8k"] Jun 02 15:21:13.466730 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:21:13.466701 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod622841f6_83ac_4fe1_b7de_2a95068beee2.slice/crio-1c8325a98233e3a13f7036681de78db617611a1f893e154b49a6c13ba877b77c WatchSource:0}: Error finding container 1c8325a98233e3a13f7036681de78db617611a1f893e154b49a6c13ba877b77c: Status 404 returned error can't find the container with id 1c8325a98233e3a13f7036681de78db617611a1f893e154b49a6c13ba877b77c Jun 02 15:21:13.715720 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:13.715643 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-745776dfd6-9kf8k" event={"ID":"622841f6-83ac-4fe1-b7de-2a95068beee2","Type":"ContainerStarted","Data":"1c8325a98233e3a13f7036681de78db617611a1f893e154b49a6c13ba877b77c"} Jun 02 15:21:14.720044 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:14.720005 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-745776dfd6-9kf8k" event={"ID":"622841f6-83ac-4fe1-b7de-2a95068beee2","Type":"ContainerStarted","Data":"4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b"} Jun 02 15:21:14.741016 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:14.740970 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-745776dfd6-9kf8k" podStartSLOduration=1.424437453 podStartE2EDuration="1.740957133s" podCreationTimestamp="2026-06-02 15:21:13 +0000 UTC" firstStartedPulling="2026-06-02 15:21:13.467973813 +0000 UTC m=+719.456603644" lastFinishedPulling="2026-06-02 15:21:13.78449349 +0000 UTC m=+719.773123324" observedRunningTime="2026-06-02 15:21:14.739514449 +0000 UTC m=+720.728144302" watchObservedRunningTime="2026-06-02 15:21:14.740957133 +0000 UTC m=+720.729586982" Jun 02 15:21:14.781302 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:14.781272 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-t9dtj"] Jun 02 15:21:14.781475 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:14.781456 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-t9dtj" podUID="87d1eb09-fe44-4d58-9c96-e35d5f595964" containerName="authorino" containerID="cri-o://cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32" gracePeriod=30 Jun 02 15:21:15.023394 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.023368 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t9dtj" Jun 02 15:21:15.137919 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.137887 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h9f4\" (UniqueName: \"kubernetes.io/projected/87d1eb09-fe44-4d58-9c96-e35d5f595964-kube-api-access-6h9f4\") pod \"87d1eb09-fe44-4d58-9c96-e35d5f595964\" (UID: \"87d1eb09-fe44-4d58-9c96-e35d5f595964\") " Jun 02 15:21:15.139771 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.139741 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d1eb09-fe44-4d58-9c96-e35d5f595964-kube-api-access-6h9f4" (OuterVolumeSpecName: "kube-api-access-6h9f4") pod "87d1eb09-fe44-4d58-9c96-e35d5f595964" (UID: "87d1eb09-fe44-4d58-9c96-e35d5f595964"). InnerVolumeSpecName "kube-api-access-6h9f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:21:15.239301 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.239263 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h9f4\" (UniqueName: \"kubernetes.io/projected/87d1eb09-fe44-4d58-9c96-e35d5f595964-kube-api-access-6h9f4\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:21:15.723932 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.723901 2575 generic.go:358] "Generic (PLEG): container finished" podID="87d1eb09-fe44-4d58-9c96-e35d5f595964" containerID="cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32" exitCode=0 Jun 02 15:21:15.724407 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.723952 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t9dtj" Jun 02 15:21:15.724407 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.723989 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t9dtj" event={"ID":"87d1eb09-fe44-4d58-9c96-e35d5f595964","Type":"ContainerDied","Data":"cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32"} Jun 02 15:21:15.724407 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.724032 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t9dtj" event={"ID":"87d1eb09-fe44-4d58-9c96-e35d5f595964","Type":"ContainerDied","Data":"dd2b1e58a83d438cc3680955de20d97a61bff7b7e1a93c0c8b3bd361d8efe681"} Jun 02 15:21:15.724407 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.724049 2575 scope.go:117] "RemoveContainer" containerID="cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32" Jun 02 15:21:15.731753 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.731738 2575 scope.go:117] "RemoveContainer" containerID="cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32" Jun 02 15:21:15.732022 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:21:15.731999 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32\": container with ID starting with cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32 not found: ID does not exist" containerID="cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32" Jun 02 15:21:15.732102 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.732028 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32"} err="failed to get container status \"cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32\": rpc error: code = NotFound desc = could not find container \"cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32\": container with ID starting with cdcc7abd672f8a1cfffd7410eb8268d50d8c2269311fcf18b75277bf359d2c32 not found: ID does not exist" Jun 02 15:21:15.746059 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.746036 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-t9dtj"] Jun 02 15:21:15.750417 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:15.750397 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-t9dtj"] Jun 02 15:21:16.586950 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:16.586914 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d1eb09-fe44-4d58-9c96-e35d5f595964" path="/var/lib/kubelet/pods/87d1eb09-fe44-4d58-9c96-e35d5f595964/volumes" Jun 02 15:21:18.188324 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.188292 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-694d9bcf7c-8vxrp"] Jun 02 15:21:18.188694 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.188589 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d1eb09-fe44-4d58-9c96-e35d5f595964" containerName="authorino" Jun 02 15:21:18.188694 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.188602 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d1eb09-fe44-4d58-9c96-e35d5f595964" containerName="authorino" Jun 02 15:21:18.188694 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.188679 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="87d1eb09-fe44-4d58-9c96-e35d5f595964" containerName="authorino" Jun 02 15:21:18.191472 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.191455 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:18.194385 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.194366 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 15:21:18.194487 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.194407 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sfvjb\"" Jun 02 15:21:18.207656 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.207632 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694d9bcf7c-8vxrp"] Jun 02 15:21:18.262321 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.262283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b5hz\" (UniqueName: \"kubernetes.io/projected/2fd47083-9298-4958-9fd8-48c40c281daa-kube-api-access-7b5hz\") pod \"maas-controller-694d9bcf7c-8vxrp\" (UID: \"2fd47083-9298-4958-9fd8-48c40c281daa\") " pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:18.301365 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.301334 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c4c6bf5b4-d9ztn"] Jun 02 15:21:18.303533 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.303517 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" Jun 02 15:21:18.320346 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.320315 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4c6bf5b4-d9ztn"] Jun 02 15:21:18.363388 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.363359 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5hz\" (UniqueName: \"kubernetes.io/projected/2fd47083-9298-4958-9fd8-48c40c281daa-kube-api-access-7b5hz\") pod \"maas-controller-694d9bcf7c-8vxrp\" (UID: \"2fd47083-9298-4958-9fd8-48c40c281daa\") " pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:18.363538 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.363412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmtbc\" (UniqueName: \"kubernetes.io/projected/31c05570-fe6c-4c1a-98ce-71b80efee2ff-kube-api-access-kmtbc\") pod \"maas-controller-c4c6bf5b4-d9ztn\" (UID: \"31c05570-fe6c-4c1a-98ce-71b80efee2ff\") " pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" Jun 02 15:21:18.372810 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.372785 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5hz\" (UniqueName: \"kubernetes.io/projected/2fd47083-9298-4958-9fd8-48c40c281daa-kube-api-access-7b5hz\") pod \"maas-controller-694d9bcf7c-8vxrp\" (UID: \"2fd47083-9298-4958-9fd8-48c40c281daa\") " pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:18.464905 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.464820 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmtbc\" (UniqueName: \"kubernetes.io/projected/31c05570-fe6c-4c1a-98ce-71b80efee2ff-kube-api-access-kmtbc\") pod \"maas-controller-c4c6bf5b4-d9ztn\" (UID: \"31c05570-fe6c-4c1a-98ce-71b80efee2ff\") " pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" Jun 02 15:21:18.473913 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.473889 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmtbc\" (UniqueName: \"kubernetes.io/projected/31c05570-fe6c-4c1a-98ce-71b80efee2ff-kube-api-access-kmtbc\") pod \"maas-controller-c4c6bf5b4-d9ztn\" (UID: \"31c05570-fe6c-4c1a-98ce-71b80efee2ff\") " pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" Jun 02 15:21:18.501767 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.501739 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:18.612880 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.612853 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" Jun 02 15:21:18.636434 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.636397 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694d9bcf7c-8vxrp"] Jun 02 15:21:18.638709 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:21:18.638686 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd47083_9298_4958_9fd8_48c40c281daa.slice/crio-0a99a7a337e8bbdb530e717f63202de46156f96a81f81460123dea4403cd7bfe WatchSource:0}: Error finding container 0a99a7a337e8bbdb530e717f63202de46156f96a81f81460123dea4403cd7bfe: Status 404 returned error can't find the container with id 0a99a7a337e8bbdb530e717f63202de46156f96a81f81460123dea4403cd7bfe Jun 02 15:21:18.640466 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.640449 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:21:18.734820 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.734747 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" event={"ID":"2fd47083-9298-4958-9fd8-48c40c281daa","Type":"ContainerStarted","Data":"0a99a7a337e8bbdb530e717f63202de46156f96a81f81460123dea4403cd7bfe"} Jun 02 15:21:18.750633 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:18.750610 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4c6bf5b4-d9ztn"] Jun 02 15:21:18.753045 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:21:18.753019 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c05570_fe6c_4c1a_98ce_71b80efee2ff.slice/crio-cd7c01fa2ec76e0a50ad495c15786fb5225ed8cb16702e96a5870bb61c3f45b3 WatchSource:0}: Error finding container cd7c01fa2ec76e0a50ad495c15786fb5225ed8cb16702e96a5870bb61c3f45b3: Status 404 returned error can't find the container with id cd7c01fa2ec76e0a50ad495c15786fb5225ed8cb16702e96a5870bb61c3f45b3 Jun 02 15:21:19.748553 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:19.748461 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" event={"ID":"31c05570-fe6c-4c1a-98ce-71b80efee2ff","Type":"ContainerStarted","Data":"cd7c01fa2ec76e0a50ad495c15786fb5225ed8cb16702e96a5870bb61c3f45b3"} Jun 02 15:21:21.756805 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:21.756713 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" event={"ID":"2fd47083-9298-4958-9fd8-48c40c281daa","Type":"ContainerStarted","Data":"ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2"} Jun 02 15:21:21.756805 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:21.756787 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:21.757999 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:21.757973 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" event={"ID":"31c05570-fe6c-4c1a-98ce-71b80efee2ff","Type":"ContainerStarted","Data":"28a636f1d8f43f0a5ab469d591831635316cfa041a98c7bc2fc6a9ba335af693"} Jun 02 15:21:21.758092 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:21.758077 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" Jun 02 15:21:21.802664 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:21.802606 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" podStartSLOduration=1.100837586 podStartE2EDuration="3.802591699s" podCreationTimestamp="2026-06-02 15:21:18 +0000 UTC" firstStartedPulling="2026-06-02 15:21:18.640567031 +0000 UTC m=+724.629196862" lastFinishedPulling="2026-06-02 15:21:21.342321132 +0000 UTC m=+727.330950975" observedRunningTime="2026-06-02 15:21:21.799064252 +0000 UTC m=+727.787694105" watchObservedRunningTime="2026-06-02 15:21:21.802591699 +0000 UTC m=+727.791221552" Jun 02 15:21:21.837841 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:21.837798 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" podStartSLOduration=1.245232527 podStartE2EDuration="3.83778485s" podCreationTimestamp="2026-06-02 15:21:18 +0000 UTC" firstStartedPulling="2026-06-02 15:21:18.754260744 +0000 UTC m=+724.742890574" lastFinishedPulling="2026-06-02 15:21:21.346813048 +0000 UTC m=+727.335442897" observedRunningTime="2026-06-02 15:21:21.833851031 +0000 UTC m=+727.822480883" watchObservedRunningTime="2026-06-02 15:21:21.83778485 +0000 UTC m=+727.826414737" Jun 02 15:21:32.767118 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:32.767086 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c4c6bf5b4-d9ztn" Jun 02 15:21:32.767906 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:32.767885 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:32.845065 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:32.845024 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694d9bcf7c-8vxrp"] Jun 02 15:21:32.845323 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:32.845284 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" podUID="2fd47083-9298-4958-9fd8-48c40c281daa" containerName="manager" containerID="cri-o://ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2" gracePeriod=30 Jun 02 15:21:33.085553 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.085532 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:33.170234 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.170206 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b5hz\" (UniqueName: \"kubernetes.io/projected/2fd47083-9298-4958-9fd8-48c40c281daa-kube-api-access-7b5hz\") pod \"2fd47083-9298-4958-9fd8-48c40c281daa\" (UID: \"2fd47083-9298-4958-9fd8-48c40c281daa\") " Jun 02 15:21:33.172296 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.172264 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd47083-9298-4958-9fd8-48c40c281daa-kube-api-access-7b5hz" (OuterVolumeSpecName: "kube-api-access-7b5hz") pod "2fd47083-9298-4958-9fd8-48c40c281daa" (UID: "2fd47083-9298-4958-9fd8-48c40c281daa"). InnerVolumeSpecName "kube-api-access-7b5hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:21:33.270985 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.270962 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b5hz\" (UniqueName: \"kubernetes.io/projected/2fd47083-9298-4958-9fd8-48c40c281daa-kube-api-access-7b5hz\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:21:33.797216 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.797165 2575 generic.go:358] "Generic (PLEG): container finished" podID="2fd47083-9298-4958-9fd8-48c40c281daa" containerID="ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2" exitCode=0 Jun 02 15:21:33.797627 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.797241 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" event={"ID":"2fd47083-9298-4958-9fd8-48c40c281daa","Type":"ContainerDied","Data":"ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2"} Jun 02 15:21:33.797627 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.797241 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" Jun 02 15:21:33.797627 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.797266 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694d9bcf7c-8vxrp" event={"ID":"2fd47083-9298-4958-9fd8-48c40c281daa","Type":"ContainerDied","Data":"0a99a7a337e8bbdb530e717f63202de46156f96a81f81460123dea4403cd7bfe"} Jun 02 15:21:33.797627 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.797281 2575 scope.go:117] "RemoveContainer" containerID="ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2" Jun 02 15:21:33.804829 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.804803 2575 scope.go:117] "RemoveContainer" containerID="ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2" Jun 02 15:21:33.805246 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:21:33.805091 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2\": container with ID starting with ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2 not found: ID does not exist" containerID="ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2" Jun 02 15:21:33.805246 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.805121 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2"} err="failed to get container status \"ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2\": rpc error: code = NotFound desc = could not find container \"ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2\": container with ID starting with ac5a09712fb9a599b6dc294583248182ffe34e6f1dd73a7c3b896a588b8dcba2 not found: ID does not exist" Jun 02 15:21:33.825039 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.825013 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694d9bcf7c-8vxrp"] Jun 02 15:21:33.828711 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:33.828689 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-694d9bcf7c-8vxrp"] Jun 02 15:21:34.586618 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:34.586580 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd47083-9298-4958-9fd8-48c40c281daa" path="/var/lib/kubelet/pods/2fd47083-9298-4958-9fd8-48c40c281daa/volumes" Jun 02 15:21:53.211385 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.211349 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-m9rrd"] Jun 02 15:21:53.212415 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.212387 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd47083-9298-4958-9fd8-48c40c281daa" containerName="manager" Jun 02 15:21:53.212415 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.212415 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd47083-9298-4958-9fd8-48c40c281daa" containerName="manager" Jun 02 15:21:53.212608 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.212515 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fd47083-9298-4958-9fd8-48c40c281daa" containerName="manager" Jun 02 15:21:53.217449 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.217432 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" Jun 02 15:21:53.220375 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.220350 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s27vl\"" Jun 02 15:21:53.220488 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.220390 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 15:21:53.226135 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.226112 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-m9rrd"] Jun 02 15:21:53.323682 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.323644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9llcw\" (UniqueName: \"kubernetes.io/projected/bb7abd71-a95b-4448-abce-538a3326234c-kube-api-access-9llcw\") pod \"payload-processing-58b6c8fdc7-m9rrd\" (UID: \"bb7abd71-a95b-4448-abce-538a3326234c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" Jun 02 15:21:53.424750 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.424714 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9llcw\" (UniqueName: \"kubernetes.io/projected/bb7abd71-a95b-4448-abce-538a3326234c-kube-api-access-9llcw\") pod \"payload-processing-58b6c8fdc7-m9rrd\" (UID: \"bb7abd71-a95b-4448-abce-538a3326234c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" Jun 02 15:21:53.433233 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.433208 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9llcw\" (UniqueName: \"kubernetes.io/projected/bb7abd71-a95b-4448-abce-538a3326234c-kube-api-access-9llcw\") pod \"payload-processing-58b6c8fdc7-m9rrd\" (UID: \"bb7abd71-a95b-4448-abce-538a3326234c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" Jun 02 15:21:53.529636 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.529610 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" Jun 02 15:21:53.670950 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.670925 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-m9rrd"] Jun 02 15:21:53.672902 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:21:53.672876 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7abd71_a95b_4448_abce_538a3326234c.slice/crio-e3b3f5b41cd2c348cec0d074ba3e5965518119465616bd30ed018ae92ffd7607 WatchSource:0}: Error finding container e3b3f5b41cd2c348cec0d074ba3e5965518119465616bd30ed018ae92ffd7607: Status 404 returned error can't find the container with id e3b3f5b41cd2c348cec0d074ba3e5965518119465616bd30ed018ae92ffd7607 Jun 02 15:21:53.861538 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:53.861459 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" event={"ID":"bb7abd71-a95b-4448-abce-538a3326234c","Type":"ContainerStarted","Data":"e3b3f5b41cd2c348cec0d074ba3e5965518119465616bd30ed018ae92ffd7607"} Jun 02 15:21:55.869686 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:55.869604 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" event={"ID":"bb7abd71-a95b-4448-abce-538a3326234c","Type":"ContainerStarted","Data":"09542185e069d08135d731d15125f459c60d73f238f102332e09828162f7cf35"} Jun 02 15:21:55.870034 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:55.869720 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" Jun 02 15:21:55.892121 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:21:55.892079 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" podStartSLOduration=1.000309616 podStartE2EDuration="2.892068353s" podCreationTimestamp="2026-06-02 15:21:53 +0000 UTC" firstStartedPulling="2026-06-02 15:21:53.674596195 +0000 UTC m=+759.663226030" lastFinishedPulling="2026-06-02 15:21:55.566354922 +0000 UTC m=+761.554984767" observedRunningTime="2026-06-02 15:21:55.890020072 +0000 UTC m=+761.878649941" watchObservedRunningTime="2026-06-02 15:21:55.892068353 +0000 UTC m=+761.880698252" Jun 02 15:22:04.547684 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:04.547647 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:22:04.548124 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:04.547878 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" containerID="cri-o://f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043" gracePeriod=30 Jun 02 15:22:06.099484 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.099462 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:06.226142 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.226067 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjxj2\" (UniqueName: \"kubernetes.io/projected/4c91e31d-6e56-46e5-9804-03bd6d9379dc-kube-api-access-vjxj2\") pod \"4c91e31d-6e56-46e5-9804-03bd6d9379dc\" (UID: \"4c91e31d-6e56-46e5-9804-03bd6d9379dc\") " Jun 02 15:22:06.228197 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.228162 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c91e31d-6e56-46e5-9804-03bd6d9379dc-kube-api-access-vjxj2" (OuterVolumeSpecName: "kube-api-access-vjxj2") pod "4c91e31d-6e56-46e5-9804-03bd6d9379dc" (UID: "4c91e31d-6e56-46e5-9804-03bd6d9379dc"). InnerVolumeSpecName "kube-api-access-vjxj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:22:06.326762 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.326738 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjxj2\" (UniqueName: \"kubernetes.io/projected/4c91e31d-6e56-46e5-9804-03bd6d9379dc-kube-api-access-vjxj2\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:22:06.875358 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.875298 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-m9rrd" Jun 02 15:22:06.918225 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.918158 2575 generic.go:358] "Generic (PLEG): container finished" podID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerID="f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043" exitCode=143 Jun 02 15:22:06.918225 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.918214 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c91e31d-6e56-46e5-9804-03bd6d9379dc","Type":"ContainerDied","Data":"f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043"} Jun 02 15:22:06.918426 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.918263 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4c91e31d-6e56-46e5-9804-03bd6d9379dc","Type":"ContainerDied","Data":"73f5fd9d3b5df60342e9edb1f3f29565fd4035448174d9177dd5d3958380cd7e"} Jun 02 15:22:06.918426 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.918271 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:06.918426 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.918284 2575 scope.go:117] "RemoveContainer" containerID="f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043" Jun 02 15:22:06.928797 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.928770 2575 scope.go:117] "RemoveContainer" containerID="f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043" Jun 02 15:22:06.929055 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:22:06.929036 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043\": container with ID starting with f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043 not found: ID does not exist" containerID="f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043" Jun 02 15:22:06.929140 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.929062 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043"} err="failed to get container status \"f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043\": rpc error: code = NotFound desc = could not find container \"f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043\": container with ID starting with f1de3a0e600aaaf87d8c2444a400568c204d20de0292e0501b63cab239313043 not found: ID does not exist" Jun 02 15:22:06.936181 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.936144 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:22:06.943464 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.943442 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:22:06.967581 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.967559 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:22:06.967946 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.967928 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" Jun 02 15:22:06.968028 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.967947 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" Jun 02 15:22:06.968087 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.968036 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" containerName="keycloak" Jun 02 15:22:06.970428 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.970411 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:06.974195 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.974161 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 15:22:06.974293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.974212 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 15:22:06.974293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.974212 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 15:22:06.974401 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.974286 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 15:22:06.974434 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.974413 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wnxp5\"" Jun 02 15:22:06.989211 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:06.989188 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:22:07.033779 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.033752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5340a465-23df-4cb3-8b96-b70ef07618d8-test-realms\") pod \"maas-keycloak-0\" (UID: \"5340a465-23df-4cb3-8b96-b70ef07618d8\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:07.033891 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.033815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn5d9\" (UniqueName: \"kubernetes.io/projected/5340a465-23df-4cb3-8b96-b70ef07618d8-kube-api-access-cn5d9\") pod \"maas-keycloak-0\" (UID: \"5340a465-23df-4cb3-8b96-b70ef07618d8\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:07.135092 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.135028 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cn5d9\" (UniqueName: \"kubernetes.io/projected/5340a465-23df-4cb3-8b96-b70ef07618d8-kube-api-access-cn5d9\") pod \"maas-keycloak-0\" (UID: \"5340a465-23df-4cb3-8b96-b70ef07618d8\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:07.135092 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.135072 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5340a465-23df-4cb3-8b96-b70ef07618d8-test-realms\") pod \"maas-keycloak-0\" (UID: \"5340a465-23df-4cb3-8b96-b70ef07618d8\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:07.135669 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.135653 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5340a465-23df-4cb3-8b96-b70ef07618d8-test-realms\") pod \"maas-keycloak-0\" (UID: \"5340a465-23df-4cb3-8b96-b70ef07618d8\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:07.144209 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.144192 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn5d9\" (UniqueName: \"kubernetes.io/projected/5340a465-23df-4cb3-8b96-b70ef07618d8-kube-api-access-cn5d9\") pod \"maas-keycloak-0\" (UID: \"5340a465-23df-4cb3-8b96-b70ef07618d8\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:07.279821 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.279793 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:07.411192 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.411150 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:22:07.923634 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.923604 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5340a465-23df-4cb3-8b96-b70ef07618d8","Type":"ContainerStarted","Data":"8d14a34d5afd3a2bb4535889585ec6b57e1ae7a34cfecd146d6666bcbc1ccf55"} Jun 02 15:22:07.923781 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.923640 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5340a465-23df-4cb3-8b96-b70ef07618d8","Type":"ContainerStarted","Data":"426e305035314e428771f5194da1008138977d455ebd03afd722c1e902ba1d42"} Jun 02 15:22:07.951679 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:07.951621 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.569826916 podStartE2EDuration="1.951608307s" podCreationTimestamp="2026-06-02 15:22:06 +0000 UTC" firstStartedPulling="2026-06-02 15:22:07.416643255 +0000 UTC m=+773.405273092" lastFinishedPulling="2026-06-02 15:22:07.798424649 +0000 UTC m=+773.787054483" observedRunningTime="2026-06-02 15:22:07.951378358 +0000 UTC m=+773.940008211" watchObservedRunningTime="2026-06-02 15:22:07.951608307 +0000 UTC m=+773.940238159" Jun 02 15:22:08.280678 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:08.280636 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:08.282256 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:08.282223 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:08.588817 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:08.588731 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c91e31d-6e56-46e5-9804-03bd6d9379dc" path="/var/lib/kubelet/pods/4c91e31d-6e56-46e5-9804-03bd6d9379dc/volumes" Jun 02 15:22:09.280760 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:09.280704 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:10.280251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:10.280199 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:11.281185 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:11.281118 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:12.280975 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:12.280917 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:13.280546 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:13.280497 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:14.280411 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:14.280363 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:15.280466 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:15.280414 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:16.281150 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:16.281089 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:17.280901 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:17.280850 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:17.281221 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:17.281185 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:18.281297 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:18.281237 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:19.280395 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:19.280347 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:20.281006 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:20.280957 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 15:22:21.411761 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:21.411723 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:21.430995 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:21.430948 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5340a465-23df-4cb3-8b96-b70ef07618d8" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:22:31.417981 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:31.417949 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:22:43.578469 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:43.578372 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-745776dfd6-9kf8k"] Jun 02 15:22:43.578929 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:43.578663 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-745776dfd6-9kf8k" podUID="622841f6-83ac-4fe1-b7de-2a95068beee2" containerName="authorino" containerID="cri-o://4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b" gracePeriod=30 Jun 02 15:22:43.828185 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:43.828150 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:22:43.927829 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:43.927738 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l4g5\" (UniqueName: \"kubernetes.io/projected/622841f6-83ac-4fe1-b7de-2a95068beee2-kube-api-access-2l4g5\") pod \"622841f6-83ac-4fe1-b7de-2a95068beee2\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " Jun 02 15:22:43.927829 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:43.927778 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/622841f6-83ac-4fe1-b7de-2a95068beee2-tls-cert\") pod \"622841f6-83ac-4fe1-b7de-2a95068beee2\" (UID: \"622841f6-83ac-4fe1-b7de-2a95068beee2\") " Jun 02 15:22:43.929855 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:43.929827 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/622841f6-83ac-4fe1-b7de-2a95068beee2-kube-api-access-2l4g5" (OuterVolumeSpecName: "kube-api-access-2l4g5") pod "622841f6-83ac-4fe1-b7de-2a95068beee2" (UID: "622841f6-83ac-4fe1-b7de-2a95068beee2"). InnerVolumeSpecName "kube-api-access-2l4g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:22:43.937293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:43.937270 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/622841f6-83ac-4fe1-b7de-2a95068beee2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "622841f6-83ac-4fe1-b7de-2a95068beee2" (UID: "622841f6-83ac-4fe1-b7de-2a95068beee2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:22:44.028978 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.028944 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/622841f6-83ac-4fe1-b7de-2a95068beee2-tls-cert\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:22:44.028978 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.028973 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l4g5\" (UniqueName: \"kubernetes.io/projected/622841f6-83ac-4fe1-b7de-2a95068beee2-kube-api-access-2l4g5\") on node \"ip-10-0-130-221.ec2.internal\" DevicePath \"\"" Jun 02 15:22:44.060236 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.060200 2575 generic.go:358] "Generic (PLEG): container finished" podID="622841f6-83ac-4fe1-b7de-2a95068beee2" containerID="4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b" exitCode=0 Jun 02 15:22:44.060382 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.060243 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-745776dfd6-9kf8k" event={"ID":"622841f6-83ac-4fe1-b7de-2a95068beee2","Type":"ContainerDied","Data":"4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b"} Jun 02 15:22:44.060382 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.060255 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745776dfd6-9kf8k" Jun 02 15:22:44.060382 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.060276 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-745776dfd6-9kf8k" event={"ID":"622841f6-83ac-4fe1-b7de-2a95068beee2","Type":"ContainerDied","Data":"1c8325a98233e3a13f7036681de78db617611a1f893e154b49a6c13ba877b77c"} Jun 02 15:22:44.060382 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.060296 2575 scope.go:117] "RemoveContainer" containerID="4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b" Jun 02 15:22:44.069732 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.069717 2575 scope.go:117] "RemoveContainer" containerID="4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b" Jun 02 15:22:44.069971 ip-10-0-130-221 kubenswrapper[2575]: E0602 15:22:44.069950 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b\": container with ID starting with 4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b not found: ID does not exist" containerID="4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b" Jun 02 15:22:44.070042 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.069984 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b"} err="failed to get container status \"4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b\": rpc error: code = NotFound desc = could not find container \"4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b\": container with ID starting with 4ac9dcf4751105becb06d67b1a3f98629ca3fd589555fa1ef8747da3704ac02b not found: ID does not exist" Jun 02 15:22:44.118481 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.118457 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-745776dfd6-9kf8k"] Jun 02 15:22:44.149394 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.149371 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-745776dfd6-9kf8k"] Jun 02 15:22:44.586259 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:44.586217 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="622841f6-83ac-4fe1-b7de-2a95068beee2" path="/var/lib/kubelet/pods/622841f6-83ac-4fe1-b7de-2a95068beee2/volumes" Jun 02 15:22:53.030229 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.030196 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz"] Jun 02 15:22:53.030659 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.030607 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622841f6-83ac-4fe1-b7de-2a95068beee2" containerName="authorino" Jun 02 15:22:53.030659 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.030625 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="622841f6-83ac-4fe1-b7de-2a95068beee2" containerName="authorino" Jun 02 15:22:53.030735 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.030706 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="622841f6-83ac-4fe1-b7de-2a95068beee2" containerName="authorino" Jun 02 15:22:53.035408 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.035386 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.038165 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.038144 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 15:22:53.038165 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.038198 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tbtct\"" Jun 02 15:22:53.039377 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.039354 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 15:22:53.039485 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.039408 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 15:22:53.053277 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.053255 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz"] Jun 02 15:22:53.206055 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.206022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.206205 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.206061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkk8x\" (UniqueName: \"kubernetes.io/projected/33225995-0e11-4292-903c-1e94b2322e1b-kube-api-access-rkk8x\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.206205 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.206081 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.206205 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.206161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.206331 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.206222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.206331 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.206299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33225995-0e11-4292-903c-1e94b2322e1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.306922 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.306863 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33225995-0e11-4292-903c-1e94b2322e1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.306922 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.306914 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.307091 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.306945 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkk8x\" (UniqueName: \"kubernetes.io/projected/33225995-0e11-4292-903c-1e94b2322e1b-kube-api-access-rkk8x\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.307091 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.306970 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.307091 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.307016 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.307091 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.307055 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.307409 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.307378 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.307494 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.307442 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.307539 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.307523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.309235 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.309218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33225995-0e11-4292-903c-1e94b2322e1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.309589 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.309568 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33225995-0e11-4292-903c-1e94b2322e1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.318620 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.318599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkk8x\" (UniqueName: \"kubernetes.io/projected/33225995-0e11-4292-903c-1e94b2322e1b-kube-api-access-rkk8x\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz\" (UID: \"33225995-0e11-4292-903c-1e94b2322e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.345599 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.345576 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:22:53.476347 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:53.476319 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz"] Jun 02 15:22:53.478529 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:22:53.478501 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33225995_0e11_4292_903c_1e94b2322e1b.slice/crio-294153840d4cee78197a0e83028e659e91a64edc3e994c9acb0fb685cced4c80 WatchSource:0}: Error finding container 294153840d4cee78197a0e83028e659e91a64edc3e994c9acb0fb685cced4c80: Status 404 returned error can't find the container with id 294153840d4cee78197a0e83028e659e91a64edc3e994c9acb0fb685cced4c80 Jun 02 15:22:54.096724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:54.096681 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" event={"ID":"33225995-0e11-4292-903c-1e94b2322e1b","Type":"ContainerStarted","Data":"294153840d4cee78197a0e83028e659e91a64edc3e994c9acb0fb685cced4c80"} Jun 02 15:22:58.113800 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:22:58.113760 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" event={"ID":"33225995-0e11-4292-903c-1e94b2322e1b","Type":"ContainerStarted","Data":"2ed6b6dae4fa115a7aab9feb859f9b07a1adff2870dfd26e5c6e941ed1ef45a8"} Jun 02 15:23:00.122318 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:00.122278 2575 generic.go:358] "Generic (PLEG): container finished" podID="33225995-0e11-4292-903c-1e94b2322e1b" containerID="2ed6b6dae4fa115a7aab9feb859f9b07a1adff2870dfd26e5c6e941ed1ef45a8" exitCode=0 Jun 02 15:23:00.122691 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:00.122355 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" event={"ID":"33225995-0e11-4292-903c-1e94b2322e1b","Type":"ContainerDied","Data":"2ed6b6dae4fa115a7aab9feb859f9b07a1adff2870dfd26e5c6e941ed1ef45a8"} Jun 02 15:23:02.131409 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:02.131378 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" event={"ID":"33225995-0e11-4292-903c-1e94b2322e1b","Type":"ContainerStarted","Data":"48e51fb5b47907b6dde856899987a34f6a3ed60fa4d152a319ed5a5fdb98f91d"} Jun 02 15:23:02.162956 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:02.162907 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" podStartSLOduration=0.902681541 podStartE2EDuration="9.162895282s" podCreationTimestamp="2026-06-02 15:22:53 +0000 UTC" firstStartedPulling="2026-06-02 15:22:53.480285315 +0000 UTC m=+819.468915150" lastFinishedPulling="2026-06-02 15:23:01.740499048 +0000 UTC m=+827.729128891" observedRunningTime="2026-06-02 15:23:02.160020398 +0000 UTC m=+828.148650262" watchObservedRunningTime="2026-06-02 15:23:02.162895282 +0000 UTC m=+828.151525135" Jun 02 15:23:03.345942 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:03.345908 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:23:03.346343 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:03.345958 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:23:03.358260 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:03.358234 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:23:04.149855 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:04.149826 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz" Jun 02 15:23:15.642851 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.642816 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5"] Jun 02 15:23:15.655981 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.655959 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.658774 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.658753 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 15:23:15.675283 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.675257 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5"] Jun 02 15:23:15.693910 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.693882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.693999 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.693929 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.694059 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.694012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.694109 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.694066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb110fb-8aa0-49dd-8903-8ff741621250-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.694109 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.694091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.694200 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.694121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj8z2\" (UniqueName: \"kubernetes.io/projected/2bb110fb-8aa0-49dd-8903-8ff741621250-kube-api-access-bj8z2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795459 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795426 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795489 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb110fb-8aa0-49dd-8903-8ff741621250-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795517 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795560 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bj8z2\" (UniqueName: \"kubernetes.io/projected/2bb110fb-8aa0-49dd-8903-8ff741621250-kube-api-access-bj8z2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795630 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795597 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795834 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795834 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.795957 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.795872 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.796042 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.796021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.797760 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.797738 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb110fb-8aa0-49dd-8903-8ff741621250-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.798013 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.797997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb110fb-8aa0-49dd-8903-8ff741621250-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.803746 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.803722 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj8z2\" (UniqueName: \"kubernetes.io/projected/2bb110fb-8aa0-49dd-8903-8ff741621250-kube-api-access-bj8z2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5\" (UID: \"2bb110fb-8aa0-49dd-8903-8ff741621250\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:15.965664 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:15.965589 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:16.102718 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:16.102687 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5"] Jun 02 15:23:16.103603 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:23:16.103573 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb110fb_8aa0_49dd_8903_8ff741621250.slice/crio-527cee17f5f735ffc94da1efdd51339f2bf126dabb97996cd84eb16de62229c7 WatchSource:0}: Error finding container 527cee17f5f735ffc94da1efdd51339f2bf126dabb97996cd84eb16de62229c7: Status 404 returned error can't find the container with id 527cee17f5f735ffc94da1efdd51339f2bf126dabb97996cd84eb16de62229c7 Jun 02 15:23:16.188520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:16.188487 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" event={"ID":"2bb110fb-8aa0-49dd-8903-8ff741621250","Type":"ContainerStarted","Data":"8eb3036d70c67009d2446f0319db2185447acc5b3a8b06ff304e3bf72cd7bf7a"} Jun 02 15:23:16.188520 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:16.188525 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" event={"ID":"2bb110fb-8aa0-49dd-8903-8ff741621250","Type":"ContainerStarted","Data":"527cee17f5f735ffc94da1efdd51339f2bf126dabb97996cd84eb16de62229c7"} Jun 02 15:23:18.196123 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:18.196083 2575 generic.go:358] "Generic (PLEG): container finished" podID="2bb110fb-8aa0-49dd-8903-8ff741621250" containerID="8eb3036d70c67009d2446f0319db2185447acc5b3a8b06ff304e3bf72cd7bf7a" exitCode=0 Jun 02 15:23:18.196606 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:18.196160 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" event={"ID":"2bb110fb-8aa0-49dd-8903-8ff741621250","Type":"ContainerDied","Data":"8eb3036d70c67009d2446f0319db2185447acc5b3a8b06ff304e3bf72cd7bf7a"} Jun 02 15:23:21.207607 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:21.207570 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" event={"ID":"2bb110fb-8aa0-49dd-8903-8ff741621250","Type":"ContainerStarted","Data":"d2e156b63da842a7de1c0890de6823671a3021a4e7bc0794abc0bc5092de357a"} Jun 02 15:23:21.233409 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:21.233363 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" podStartSLOduration=3.406121005 podStartE2EDuration="6.233349888s" podCreationTimestamp="2026-06-02 15:23:15 +0000 UTC" firstStartedPulling="2026-06-02 15:23:18.196901618 +0000 UTC m=+844.185531450" lastFinishedPulling="2026-06-02 15:23:21.024130499 +0000 UTC m=+847.012760333" observedRunningTime="2026-06-02 15:23:21.232726044 +0000 UTC m=+847.221355923" watchObservedRunningTime="2026-06-02 15:23:21.233349888 +0000 UTC m=+847.221979741" Jun 02 15:23:25.966683 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:25.966651 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:25.967122 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:25.966695 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:25.979673 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:25.979647 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:26.236035 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:26.235959 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5" Jun 02 15:23:37.817581 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.817547 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92"] Jun 02 15:23:37.821269 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.821250 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:37.824119 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.824097 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 15:23:37.834968 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.834945 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92"] Jun 02 15:23:37.982361 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.982334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70abd245-627a-4746-ac80-5950b3df2a6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:37.982488 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.982409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:37.982488 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.982445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:37.982488 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.982482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:37.982619 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.982520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:37.982619 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:37.982537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6kjz\" (UniqueName: \"kubernetes.io/projected/70abd245-627a-4746-ac80-5950b3df2a6d-kube-api-access-q6kjz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.083894 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.083831 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.083894 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.083877 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.084026 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.083905 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6kjz\" (UniqueName: \"kubernetes.io/projected/70abd245-627a-4746-ac80-5950b3df2a6d-kube-api-access-q6kjz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.084026 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.083937 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70abd245-627a-4746-ac80-5950b3df2a6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.084026 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.084013 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.084159 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.084040 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.084247 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.084218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.084314 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.084295 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.084370 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.084334 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.086312 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.086290 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70abd245-627a-4746-ac80-5950b3df2a6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.086603 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.086582 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70abd245-627a-4746-ac80-5950b3df2a6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.092547 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.092525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6kjz\" (UniqueName: \"kubernetes.io/projected/70abd245-627a-4746-ac80-5950b3df2a6d-kube-api-access-q6kjz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92\" (UID: \"70abd245-627a-4746-ac80-5950b3df2a6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.131354 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.131333 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:38.257519 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:38.257469 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92"] Jun 02 15:23:38.259707 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:23:38.259676 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70abd245_627a_4746_ac80_5950b3df2a6d.slice/crio-1a833ee931c99b805dfa436762db48d2d3ce9b38daf0f521cd88411fb69945dc WatchSource:0}: Error finding container 1a833ee931c99b805dfa436762db48d2d3ce9b38daf0f521cd88411fb69945dc: Status 404 returned error can't find the container with id 1a833ee931c99b805dfa436762db48d2d3ce9b38daf0f521cd88411fb69945dc Jun 02 15:23:39.266713 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:39.266679 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" event={"ID":"70abd245-627a-4746-ac80-5950b3df2a6d","Type":"ContainerStarted","Data":"c99a0a612085417dcfe5a4ef140765e8860be739e0c0e4486feb8f00b1b84503"} Jun 02 15:23:39.266713 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:39.266714 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" event={"ID":"70abd245-627a-4746-ac80-5950b3df2a6d","Type":"ContainerStarted","Data":"1a833ee931c99b805dfa436762db48d2d3ce9b38daf0f521cd88411fb69945dc"} Jun 02 15:23:40.271251 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:40.271219 2575 generic.go:358] "Generic (PLEG): container finished" podID="70abd245-627a-4746-ac80-5950b3df2a6d" containerID="c99a0a612085417dcfe5a4ef140765e8860be739e0c0e4486feb8f00b1b84503" exitCode=0 Jun 02 15:23:40.271642 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:40.271307 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" event={"ID":"70abd245-627a-4746-ac80-5950b3df2a6d","Type":"ContainerDied","Data":"c99a0a612085417dcfe5a4ef140765e8860be739e0c0e4486feb8f00b1b84503"} Jun 02 15:23:42.327039 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.326995 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq"] Jun 02 15:23:42.330418 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.330398 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.333346 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.333326 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 15:23:42.401149 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.401119 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq"] Jun 02 15:23:42.418435 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.418407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.418529 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.418444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.418529 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.418504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.418609 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.418542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msmtb\" (UniqueName: \"kubernetes.io/projected/fd8a2587-a979-4141-b6c2-2769fd172126-kube-api-access-msmtb\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.418644 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.418636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd8a2587-a979-4141-b6c2-2769fd172126-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.418679 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.418662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519433 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519407 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd8a2587-a979-4141-b6c2-2769fd172126-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519546 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519444 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519546 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519469 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519546 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519495 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519549 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519700 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519578 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msmtb\" (UniqueName: \"kubernetes.io/projected/fd8a2587-a979-4141-b6c2-2769fd172126-kube-api-access-msmtb\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519860 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519794 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519860 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519850 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.519972 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.519923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.521753 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.521724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd8a2587-a979-4141-b6c2-2769fd172126-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.521860 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.521818 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd8a2587-a979-4141-b6c2-2769fd172126-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.528720 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.528698 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msmtb\" (UniqueName: \"kubernetes.io/projected/fd8a2587-a979-4141-b6c2-2769fd172126-kube-api-access-msmtb\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq\" (UID: \"fd8a2587-a979-4141-b6c2-2769fd172126\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.640250 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.640156 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:42.767146 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:42.767093 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq"] Jun 02 15:23:42.769342 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:23:42.769314 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8a2587_a979_4141_b6c2_2769fd172126.slice/crio-d0c47883cceb7755f60e50d17b095db65c19f54154e62acb23e9251cdb5dcb55 WatchSource:0}: Error finding container d0c47883cceb7755f60e50d17b095db65c19f54154e62acb23e9251cdb5dcb55: Status 404 returned error can't find the container with id d0c47883cceb7755f60e50d17b095db65c19f54154e62acb23e9251cdb5dcb55 Jun 02 15:23:43.284000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:43.283966 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" event={"ID":"fd8a2587-a979-4141-b6c2-2769fd172126","Type":"ContainerStarted","Data":"573971f62dd37a521cd91cd66498a2f4a5914b76fa1df808c278b809a4083796"} Jun 02 15:23:43.284000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:43.284004 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" event={"ID":"fd8a2587-a979-4141-b6c2-2769fd172126","Type":"ContainerStarted","Data":"d0c47883cceb7755f60e50d17b095db65c19f54154e62acb23e9251cdb5dcb55"} Jun 02 15:23:44.289591 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:44.289554 2575 generic.go:358] "Generic (PLEG): container finished" podID="fd8a2587-a979-4141-b6c2-2769fd172126" containerID="573971f62dd37a521cd91cd66498a2f4a5914b76fa1df808c278b809a4083796" exitCode=0 Jun 02 15:23:44.289961 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:44.289635 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" event={"ID":"fd8a2587-a979-4141-b6c2-2769fd172126","Type":"ContainerDied","Data":"573971f62dd37a521cd91cd66498a2f4a5914b76fa1df808c278b809a4083796"} Jun 02 15:23:45.294143 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:45.294108 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" event={"ID":"70abd245-627a-4746-ac80-5950b3df2a6d","Type":"ContainerStarted","Data":"854bc222f7c260f2916cf7d881f05a7823ca0584716d70750b9cc772f4dd0330"} Jun 02 15:23:45.315292 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:45.315249 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" podStartSLOduration=3.9339129489999998 podStartE2EDuration="8.315236825s" podCreationTimestamp="2026-06-02 15:23:37 +0000 UTC" firstStartedPulling="2026-06-02 15:23:40.271764986 +0000 UTC m=+866.260394817" lastFinishedPulling="2026-06-02 15:23:44.653088843 +0000 UTC m=+870.641718693" observedRunningTime="2026-06-02 15:23:45.313484 +0000 UTC m=+871.302113850" watchObservedRunningTime="2026-06-02 15:23:45.315236825 +0000 UTC m=+871.303866678" Jun 02 15:23:48.132123 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:48.132079 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:48.132123 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:48.132133 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:48.144204 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:48.144162 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:48.315950 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:48.315926 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92" Jun 02 15:23:51.316660 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:51.316621 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" event={"ID":"fd8a2587-a979-4141-b6c2-2769fd172126","Type":"ContainerStarted","Data":"05df7ff2d950fe5191c8094319b504fbdf02baa7aaaf2929042bbe2273efc16e"} Jun 02 15:23:51.336252 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:51.336194 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" podStartSLOduration=3.361421108 podStartE2EDuration="9.336161754s" podCreationTimestamp="2026-06-02 15:23:42 +0000 UTC" firstStartedPulling="2026-06-02 15:23:44.290108363 +0000 UTC m=+870.278738193" lastFinishedPulling="2026-06-02 15:23:50.264849008 +0000 UTC m=+876.253478839" observedRunningTime="2026-06-02 15:23:51.334984847 +0000 UTC m=+877.323614727" watchObservedRunningTime="2026-06-02 15:23:51.336161754 +0000 UTC m=+877.324791609" Jun 02 15:23:52.640664 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:52.640631 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:52.641042 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:52.640675 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:52.653059 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:52.653033 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:23:53.333994 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:23:53.333964 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq" Jun 02 15:29:52.606542 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:52.606513 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c4c6bf5b4-d9ztn_31c05570-fe6c-4c1a-98ce-71b80efee2ff/manager/0.log" Jun 02 15:29:53.209592 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:53.209554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-l8w7w_e868aff3-5b4d-4f47-b664-7aebda66bf5d/manager/0.log" Jun 02 15:29:53.216712 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:53.216693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-l8w7w_e868aff3-5b4d-4f47-b664-7aebda66bf5d/copy-manifests/0.log" Jun 02 15:29:53.332892 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:53.332872 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-w86z7_2395a0b3-3205-4af6-80f1-a7d526569b94/postgres/0.log" Jun 02 15:29:55.039073 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:55.039045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-ncdrb_cf33ebb8-632e-4f0c-823a-49387638805b/kuadrant-console-plugin/0.log" Jun 02 15:29:56.211497 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:56.211460 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c6f598cb-77vmx_2b9855e2-9c7b-484f-9286-42dd14936c8a/kube-auth-proxy/0.log" Jun 02 15:29:56.708502 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:56.708462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-m9rrd_bb7abd71-a95b-4448-abce-538a3326234c/payload-processing/0.log" Jun 02 15:29:56.840887 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:56.840855 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7468c64bd5-lldhp_7c287ef1-a572-40ba-ae35-9adb0e611702/router/0.log" Jun 02 15:29:57.237846 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.237821 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz_33225995-0e11-4292-903c-1e94b2322e1b/storage-initializer/0.log" Jun 02 15:29:57.245752 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.245725 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-mmnnz_33225995-0e11-4292-903c-1e94b2322e1b/main/0.log" Jun 02 15:29:57.501974 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.501898 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5_2bb110fb-8aa0-49dd-8903-8ff741621250/storage-initializer/0.log" Jun 02 15:29:57.509672 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.509651 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-jx9j5_2bb110fb-8aa0-49dd-8903-8ff741621250/main/0.log" Jun 02 15:29:57.637935 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.637913 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92_70abd245-627a-4746-ac80-5950b3df2a6d/storage-initializer/0.log" Jun 02 15:29:57.646878 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.646854 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92rf92_70abd245-627a-4746-ac80-5950b3df2a6d/main/0.log" Jun 02 15:29:57.775000 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.774934 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq_fd8a2587-a979-4141-b6c2-2769fd172126/storage-initializer/0.log" Jun 02 15:29:57.783146 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:29:57.783120 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-9jhnq_fd8a2587-a979-4141-b6c2-2769fd172126/main/0.log" Jun 02 15:30:05.834726 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:05.834637 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tzn79_ccd6dfbf-ac8a-4657-839c-33555a71e2b9/global-pull-secret-syncer/0.log" Jun 02 15:30:05.925676 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:05.925635 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j7tzj_8db04ac7-0181-46e1-9c72-27797418f9bd/konnectivity-agent/0.log" Jun 02 15:30:06.017385 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:06.017356 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-221.ec2.internal_927300f7c57ab2a0de8ae3d4c341220d/haproxy/0.log" Jun 02 15:30:10.549990 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:10.549965 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-ncdrb_cf33ebb8-632e-4f0c-823a-49387638805b/kuadrant-console-plugin/0.log" Jun 02 15:30:12.069501 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.069473 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c32f72f-736d-47bd-b1ad-cc2b38b40ad5/alertmanager/0.log" Jun 02 15:30:12.092742 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.092720 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c32f72f-736d-47bd-b1ad-cc2b38b40ad5/config-reloader/0.log" Jun 02 15:30:12.126107 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.126084 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c32f72f-736d-47bd-b1ad-cc2b38b40ad5/kube-rbac-proxy-web/0.log" Jun 02 15:30:12.151837 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.151810 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c32f72f-736d-47bd-b1ad-cc2b38b40ad5/kube-rbac-proxy/0.log" Jun 02 15:30:12.178191 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.178149 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c32f72f-736d-47bd-b1ad-cc2b38b40ad5/kube-rbac-proxy-metric/0.log" Jun 02 15:30:12.205241 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.205224 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c32f72f-736d-47bd-b1ad-cc2b38b40ad5/prom-label-proxy/0.log" Jun 02 15:30:12.236517 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.236497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c32f72f-736d-47bd-b1ad-cc2b38b40ad5/init-config-reloader/0.log" Jun 02 15:30:12.417495 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.417418 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77f48b67c4-g2qld_5ca4376f-d869-4a29-a444-7bcac7ee372e/metrics-server/0.log" Jun 02 15:30:12.479586 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.479565 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lgmq_7683e488-037a-4ec9-bd4a-f5c4d58d5ec3/node-exporter/0.log" Jun 02 15:30:12.501090 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.501072 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lgmq_7683e488-037a-4ec9-bd4a-f5c4d58d5ec3/kube-rbac-proxy/0.log" Jun 02 15:30:12.523258 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.523240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lgmq_7683e488-037a-4ec9-bd4a-f5c4d58d5ec3/init-textfile/0.log" Jun 02 15:30:12.806112 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.806088 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f4a8ad-5ab2-4a02-8684-eecf46de9552/prometheus/0.log" Jun 02 15:30:12.826476 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.826456 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f4a8ad-5ab2-4a02-8684-eecf46de9552/config-reloader/0.log" Jun 02 15:30:12.846809 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.846787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f4a8ad-5ab2-4a02-8684-eecf46de9552/thanos-sidecar/0.log" Jun 02 15:30:12.866262 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.866240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f4a8ad-5ab2-4a02-8684-eecf46de9552/kube-rbac-proxy-web/0.log" Jun 02 15:30:12.885535 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.885507 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f4a8ad-5ab2-4a02-8684-eecf46de9552/kube-rbac-proxy/0.log" Jun 02 15:30:12.905206 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.905182 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f4a8ad-5ab2-4a02-8684-eecf46de9552/kube-rbac-proxy-thanos/0.log" Jun 02 15:30:12.923950 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.923933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f4a8ad-5ab2-4a02-8684-eecf46de9552/init-config-reloader/0.log" Jun 02 15:30:12.990890 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:12.990857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-jpflr_2f728f20-e4ae-452c-b2a4-4aa6f06b3b99/prometheus-operator-admission-webhook/0.log" Jun 02 15:30:14.314332 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:14.314305 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-slljc_7bb49267-5855-45ff-87a0-4ee3789da90e/networking-console-plugin/0.log" Jun 02 15:30:15.596534 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.596502 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt"] Jun 02 15:30:15.599992 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.599973 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.602439 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.602419 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x79r2\"/\"openshift-service-ca.crt\"" Jun 02 15:30:15.603598 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.603584 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x79r2\"/\"default-dockercfg-rwpxj\"" Jun 02 15:30:15.603659 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.603596 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x79r2\"/\"kube-root-ca.crt\"" Jun 02 15:30:15.607045 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.607026 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt"] Jun 02 15:30:15.622709 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.622688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-sys\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.622803 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.622719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-podres\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.622803 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.622744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrcj\" (UniqueName: \"kubernetes.io/projected/0eb34e01-e0fa-443a-984e-49cea56b2c04-kube-api-access-ttrcj\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.622803 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.622780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-proc\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.622917 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.622813 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-lib-modules\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723601 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-sys\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723612 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-podres\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723635 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrcj\" (UniqueName: \"kubernetes.io/projected/0eb34e01-e0fa-443a-984e-49cea56b2c04-kube-api-access-ttrcj\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723724 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723687 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-sys\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723828 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-podres\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723828 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-proc\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723828 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723821 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-lib-modules\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723924 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723892 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-proc\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.723958 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.723948 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eb34e01-e0fa-443a-984e-49cea56b2c04-lib-modules\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.730976 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.730959 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrcj\" (UniqueName: \"kubernetes.io/projected/0eb34e01-e0fa-443a-984e-49cea56b2c04-kube-api-access-ttrcj\") pod \"perf-node-gather-daemonset-mzczt\" (UID: \"0eb34e01-e0fa-443a-984e-49cea56b2c04\") " pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:15.910863 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:15.910793 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:16.041081 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.041054 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt"] Jun 02 15:30:16.044152 ip-10-0-130-221 kubenswrapper[2575]: W0602 15:30:16.044115 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0eb34e01_e0fa_443a_984e_49cea56b2c04.slice/crio-aef0024425864300e45d4258ee35d81308f24b8eb37522612bdd326f6a766224 WatchSource:0}: Error finding container aef0024425864300e45d4258ee35d81308f24b8eb37522612bdd326f6a766224: Status 404 returned error can't find the container with id aef0024425864300e45d4258ee35d81308f24b8eb37522612bdd326f6a766224 Jun 02 15:30:16.046051 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.046035 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:30:16.642861 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.642827 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" event={"ID":"0eb34e01-e0fa-443a-984e-49cea56b2c04","Type":"ContainerStarted","Data":"2636aecc69795fc46b5636be304fa8019feb4dbb33ba9c6fb296e5af7237b4c9"} Jun 02 15:30:16.642861 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.642859 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" event={"ID":"0eb34e01-e0fa-443a-984e-49cea56b2c04","Type":"ContainerStarted","Data":"aef0024425864300e45d4258ee35d81308f24b8eb37522612bdd326f6a766224"} Jun 02 15:30:16.643457 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.642937 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:16.659110 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.659068 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" podStartSLOduration=1.659055903 podStartE2EDuration="1.659055903s" podCreationTimestamp="2026-06-02 15:30:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:30:16.658307015 +0000 UTC m=+1262.646936865" watchObservedRunningTime="2026-06-02 15:30:16.659055903 +0000 UTC m=+1262.647685757" Jun 02 15:30:16.869960 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.869931 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hv9r6_7f5d51bd-b247-4c79-afc7-1d69bb739b05/dns/0.log" Jun 02 15:30:16.890470 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.890433 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hv9r6_7f5d51bd-b247-4c79-afc7-1d69bb739b05/kube-rbac-proxy/0.log" Jun 02 15:30:16.933291 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:16.933205 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ldbwc_abea5766-591c-41b6-82a7-20a67699acc6/dns-node-resolver/0.log" Jun 02 15:30:17.465364 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:17.465331 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8cmf_0956e794-2ecc-4bed-bf5e-0b98b72fc529/node-ca/0.log" Jun 02 15:30:18.465293 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:18.465262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c6f598cb-77vmx_2b9855e2-9c7b-484f-9286-42dd14936c8a/kube-auth-proxy/0.log" Jun 02 15:30:18.563475 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:18.563442 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-m9rrd_bb7abd71-a95b-4448-abce-538a3326234c/payload-processing/0.log" Jun 02 15:30:18.588135 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:18.588115 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7468c64bd5-lldhp_7c287ef1-a572-40ba-ae35-9adb0e611702/router/0.log" Jun 02 15:30:19.163561 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:19.163534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-65v88_7d50d78c-3fbf-4184-bda9-9b4de727ccd2/serve-healthcheck-canary/0.log" Jun 02 15:30:19.882669 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:19.882641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l94c4_6e87fa64-87ea-4a87-b91a-562c0272e0d0/kube-rbac-proxy/0.log" Jun 02 15:30:19.906751 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:19.906722 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l94c4_6e87fa64-87ea-4a87-b91a-562c0272e0d0/exporter/0.log" Jun 02 15:30:19.932864 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:19.932842 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l94c4_6e87fa64-87ea-4a87-b91a-562c0272e0d0/extractor/0.log" Jun 02 15:30:22.229604 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:22.229569 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c4c6bf5b4-d9ztn_31c05570-fe6c-4c1a-98ce-71b80efee2ff/manager/0.log" Jun 02 15:30:22.540308 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:22.540278 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-l8w7w_e868aff3-5b4d-4f47-b664-7aebda66bf5d/manager/0.log" Jun 02 15:30:22.562296 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:22.562271 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5889c5df7b-l8w7w_e868aff3-5b4d-4f47-b664-7aebda66bf5d/copy-manifests/0.log" Jun 02 15:30:22.587205 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:22.587161 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-w86z7_2395a0b3-3205-4af6-80f1-a7d526569b94/postgres/0.log" Jun 02 15:30:22.656783 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:22.656757 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x79r2/perf-node-gather-daemonset-mzczt" Jun 02 15:30:23.946400 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:23.946373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cfd44ccff-s8qrj_4d3632c4-fa8a-4b01-90e5-ba4e6d837e2b/manager/0.log" Jun 02 15:30:24.003741 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:24.003708 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-hvhwf_83319a6a-db1d-4c8b-abb6-eed6e24fb500/openshift-lws-operator/0.log" Jun 02 15:30:30.768433 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.768405 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-94tzf_ac61bc8b-025e-4ee3-8a31-41bcdee6da26/kube-multus-additional-cni-plugins/0.log" Jun 02 15:30:30.789874 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.789853 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-94tzf_ac61bc8b-025e-4ee3-8a31-41bcdee6da26/egress-router-binary-copy/0.log" Jun 02 15:30:30.811351 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.811327 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-94tzf_ac61bc8b-025e-4ee3-8a31-41bcdee6da26/cni-plugins/0.log" Jun 02 15:30:30.830977 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.830955 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-94tzf_ac61bc8b-025e-4ee3-8a31-41bcdee6da26/bond-cni-plugin/0.log" Jun 02 15:30:30.851731 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.851712 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-94tzf_ac61bc8b-025e-4ee3-8a31-41bcdee6da26/routeoverride-cni/0.log" Jun 02 15:30:30.873104 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.873083 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-94tzf_ac61bc8b-025e-4ee3-8a31-41bcdee6da26/whereabouts-cni-bincopy/0.log" Jun 02 15:30:30.892142 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.892124 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-94tzf_ac61bc8b-025e-4ee3-8a31-41bcdee6da26/whereabouts-cni/0.log" Jun 02 15:30:30.990391 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:30.990368 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zrw2p_b4e2b5c8-c339-40a2-95a1-05360fc37db3/kube-multus/0.log" Jun 02 15:30:31.014340 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:31.014311 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9gfmq_75b890ed-1d05-439e-984d-61d35ed04b3b/network-metrics-daemon/0.log" Jun 02 15:30:31.032610 ip-10-0-130-221 kubenswrapper[2575]: I0602 15:30:31.032591 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9gfmq_75b890ed-1d05-439e-984d-61d35ed04b3b/kube-rbac-proxy/0.log"