Jun 03 13:47:37.260538 ip-10-0-139-48 systemd[1]: Starting Kubernetes Kubelet... Jun 03 13:47:37.748719 ip-10-0-139-48 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:47:37.748719 ip-10-0-139-48 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 13:47:37.748719 ip-10-0-139-48 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:47:37.748719 ip-10-0-139-48 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 13:47:37.748719 ip-10-0-139-48 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:47:37.751435 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.751338 2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 13:47:37.757053 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757025 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:47:37.757053 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757047 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:47:37.757053 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757050 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:47:37.757053 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757054 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:47:37.757053 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757057 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:47:37.757053 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757060 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:47:37.757053 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757063 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757065 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757068 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757072 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757075 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757078 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757080 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757083 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757085 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757088 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757090 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757093 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757096 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757099 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757101 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757104 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757107 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757110 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757112 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757117 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:47:37.757330 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757121 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757125 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757130 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757134 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757138 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757141 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757145 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757147 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757150 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757152 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757155 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757158 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757161 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757164 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757168 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757171 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757173 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757176 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757179 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:47:37.757811 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757182 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757184 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757187 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757189 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757192 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757195 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757197 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757200 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757203 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757205 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757208 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757210 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757213 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757215 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757236 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757239 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757241 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757244 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757247 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:47:37.758381 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757250 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757252 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757255 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757257 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757260 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757263 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757265 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757268 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757272 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757275 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757278 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757280 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757284 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757286 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757290 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757293 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757296 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757299 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757301 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757304 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:47:37.758845 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757307 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757309 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757725 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757731 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757734 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757736 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757739 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757742 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757744 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757747 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757750 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757752 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757755 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757757 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757761 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757764 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757767 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757769 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757772 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757774 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:47:37.759351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757778 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757781 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757783 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757786 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757788 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757791 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757796 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757800 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757803 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757806 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757808 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757811 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757813 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757817 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757820 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757822 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757825 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757828 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757831 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757833 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:47:37.759831 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757836 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757839 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757841 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757844 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757846 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757849 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757851 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757854 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757857 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757859 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757862 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757865 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757867 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757870 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757873 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757875 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757878 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757880 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757883 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:47:37.760347 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757886 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757888 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757891 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757893 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757896 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757898 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757901 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757903 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757906 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757909 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757911 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757913 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757916 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757918 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757921 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757923 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757926 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757928 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757931 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757933 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:47:37.760865 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757936 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757938 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757941 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757944 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757946 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757949 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757952 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757955 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.757958 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759267 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759276 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759284 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759289 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759294 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759298 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759302 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759306 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759310 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759313 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759317 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759321 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759324 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 13:47:37.761379 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759327 2562 flags.go:64] FLAG: --cgroup-root="" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759330 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759333 2562 flags.go:64] FLAG: --client-ca-file="" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759337 2562 flags.go:64] FLAG: --cloud-config="" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759340 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759343 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759347 2562 flags.go:64] FLAG: --cluster-domain="" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759350 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759354 2562 flags.go:64] FLAG: --config-dir="" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759358 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759361 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759365 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759369 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759372 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759376 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759379 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759382 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759384 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759388 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759390 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759395 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759398 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759400 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759403 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759407 2562 flags.go:64] FLAG: --enable-server="true" Jun 03 13:47:37.761988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759411 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759415 2562 flags.go:64] FLAG: --event-burst="100" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759419 2562 flags.go:64] FLAG: --event-qps="50" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759422 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759425 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759428 2562 flags.go:64] FLAG: --eviction-hard="" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759432 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759435 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759438 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759441 2562 flags.go:64] FLAG: --eviction-soft="" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759444 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759447 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759450 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759453 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759456 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759459 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759462 2562 flags.go:64] FLAG: --feature-gates="" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759466 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759469 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759472 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759475 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759479 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759482 2562 flags.go:64] FLAG: --help="false" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759484 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-139-48.ec2.internal" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759488 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 13:47:37.762609 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759491 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759494 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759497 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759500 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759503 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759506 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759509 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759512 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759515 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759518 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759521 2562 flags.go:64] FLAG: --kube-reserved="" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759524 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759527 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759530 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759533 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759536 2562 flags.go:64] FLAG: --lock-file="" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759538 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759542 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759544 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759550 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759553 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759555 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759558 2562 flags.go:64] FLAG: --logging-format="text" Jun 03 13:47:37.763211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759561 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759565 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759568 2562 flags.go:64] FLAG: --manifest-url="" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759571 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759575 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759578 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759582 2562 flags.go:64] FLAG: --max-pods="110" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759585 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759588 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759591 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759594 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759597 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759600 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759603 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759610 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759613 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759616 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759620 2562 flags.go:64] FLAG: --pod-cidr="" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759623 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759629 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759632 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759635 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759638 2562 flags.go:64] FLAG: --port="10250" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759641 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 13:47:37.763788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759644 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b0972a244e5453b" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759648 2562 flags.go:64] FLAG: --qos-reserved="" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759651 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759654 2562 flags.go:64] FLAG: --register-node="true" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759657 2562 flags.go:64] FLAG: --register-schedulable="true" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759660 2562 flags.go:64] FLAG: --register-with-taints="" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759664 2562 flags.go:64] FLAG: --registry-burst="10" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759667 2562 flags.go:64] FLAG: --registry-qps="5" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759669 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759672 2562 flags.go:64] FLAG: --reserved-memory="" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759677 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759680 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759683 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759686 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759689 2562 flags.go:64] FLAG: --runonce="false" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759692 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759695 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759698 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759701 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759704 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759707 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759711 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759713 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759716 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759719 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759722 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 13:47:37.764446 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759726 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759729 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759732 2562 flags.go:64] FLAG: --system-cgroups="" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759735 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759741 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759743 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759746 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759751 2562 flags.go:64] FLAG: --tls-min-version="" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759753 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759756 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759760 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759763 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759766 2562 flags.go:64] FLAG: --v="2" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759770 2562 flags.go:64] FLAG: --version="false" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759774 2562 flags.go:64] FLAG: --vmodule="" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759781 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.759784 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760841 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760846 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760850 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760852 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760855 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760859 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:47:37.765078 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760862 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760864 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760867 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760870 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760874 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760877 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760880 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760883 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760886 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760890 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760893 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760896 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760898 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760901 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760904 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760906 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760909 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760911 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760914 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760917 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:47:37.765653 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760919 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760922 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760924 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760927 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760930 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760932 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760935 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760937 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760940 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760943 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760945 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760948 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760952 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760955 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760957 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760960 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760963 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760965 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760968 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760970 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:47:37.766206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760973 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760977 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760979 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760982 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760985 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760989 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760992 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760994 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.760997 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761000 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761002 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761005 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761007 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761010 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761012 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761015 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761018 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761020 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761022 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761025 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:47:37.766720 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761027 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761030 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761033 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761035 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761037 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761040 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761042 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761045 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761047 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761050 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761053 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761055 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761058 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761062 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761064 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761067 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761070 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761072 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761075 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:47:37.767206 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.761077 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:47:37.767727 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.762054 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:47:37.768957 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.768833 2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 13:47:37.768998 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.768958 2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 13:47:37.769032 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769012 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:47:37.769032 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769018 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:47:37.769032 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769021 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:47:37.769032 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769024 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:47:37.769032 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769028 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:47:37.769032 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769031 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:47:37.769032 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769034 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769037 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769039 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769042 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769045 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769048 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769051 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769054 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769056 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769059 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769061 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769064 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769066 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769069 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769072 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769074 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769077 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769081 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769084 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:47:37.769205 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769089 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769092 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769095 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769097 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769100 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769103 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769105 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769108 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769110 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769113 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769116 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769118 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769121 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769125 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769128 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769132 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769135 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769138 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769141 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:47:37.769685 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769144 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769146 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769149 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769152 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769154 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769157 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769159 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769162 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769165 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769168 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769170 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769173 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769176 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769178 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769184 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769187 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769189 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769192 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769194 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769197 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:47:37.770165 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769200 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769203 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769206 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769208 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769211 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769214 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769232 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769237 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769242 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769246 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769249 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769252 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769255 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769258 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769260 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769263 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769265 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769268 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769271 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769274 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:47:37.770714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769276 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769279 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.769284 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769389 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769394 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769397 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769399 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769403 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769407 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769410 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769413 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769415 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769418 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769421 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769424 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769426 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:47:37.771207 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769430 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769434 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769437 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769440 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769443 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769447 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769449 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769452 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769455 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769457 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769460 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769462 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769465 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769468 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769470 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769473 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769475 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769478 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769480 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769483 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:47:37.771612 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769485 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769488 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769490 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769493 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769496 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769499 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769501 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769504 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769506 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769509 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769511 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769515 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769519 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769522 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769525 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769528 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769531 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769533 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769536 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:47:37.772101 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769539 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769541 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769544 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769547 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769549 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769551 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769554 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769557 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769559 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769562 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769564 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769567 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769569 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769572 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769575 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769577 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769580 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769582 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769585 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769588 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:47:37.772597 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769590 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769593 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769596 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769598 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769601 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769603 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769605 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769608 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769611 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769614 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769616 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769619 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769622 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:37.769624 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.769629 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:47:37.773131 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.769757 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 13:47:37.773543 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.772587 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 13:47:37.773602 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.773590 2562 server.go:1019] "Starting client certificate rotation" Jun 03 13:47:37.773710 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.773691 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 13:47:37.773743 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.773732 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 13:47:37.803922 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.803898 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 13:47:37.805901 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.805873 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 13:47:37.821173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.821144 2562 log.go:25] "Validated CRI v1 runtime API" Jun 03 13:47:37.827036 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.827014 2562 log.go:25] "Validated CRI v1 image API" Jun 03 13:47:37.828589 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.828566 2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 13:47:37.832445 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.832410 2562 fs.go:135] Filesystem UUIDs: map[02759c82-267f-4aa5-8b59-9982c14310bf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fe77eade-970f-4757-9bef-73efdbb60bf9:/dev/nvme0n1p3] Jun 03 13:47:37.832537 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.832444 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 13:47:37.836830 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.836709 2562 manager.go:217] Machine: {Timestamp:2026-06-03 13:47:37.83618049 +0000 UTC m=+0.448585798 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099399 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c9e78c7d0f111d2091b396c868a69 SystemUUID:ec2c9e78-c7d0-f111-d209-1b396c868a69 BootID:c05c2730-f322-4656-9257-1f5b1a65d185 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:22:fc:d2:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:22:fc:d2:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:e9:fb:cf:34:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 13:47:37.836830 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.836822 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 13:47:37.836979 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.836959 2562 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 13:47:37.838808 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.838777 2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 13:47:37.838956 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.838810 2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 13:47:37.838997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.838968 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 13:47:37.838997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.838978 2562 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 13:47:37.838997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.838990 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 13:47:37.839083 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.839001 2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 13:47:37.839608 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.839595 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 13:47:37.840672 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.840658 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 03 13:47:37.840799 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.840790 2562 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 13:47:37.843700 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.843688 2562 kubelet.go:491] "Attempting to sync node with API server" Jun 03 13:47:37.843741 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.843705 2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 13:47:37.843741 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.843718 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 13:47:37.843741 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.843727 2562 kubelet.go:397] "Adding apiserver pod source" Jun 03 13:47:37.843741 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.843736 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 13:47:37.845245 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.845233 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 13:47:37.845293 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.845254 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 13:47:37.848968 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.848951 2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 13:47:37.851004 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.850991 2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 13:47:37.853373 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853360 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 13:47:37.853423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853378 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 13:47:37.853423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853385 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 13:47:37.853423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853391 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 13:47:37.853423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853400 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 13:47:37.853423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853406 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 13:47:37.853423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853414 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 13:47:37.853423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853420 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 13:47:37.853624 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853427 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 13:47:37.853624 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853433 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 13:47:37.853624 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853446 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 13:47:37.853624 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.853452 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 13:47:37.854317 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.854307 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 13:47:37.854354 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.854318 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 13:47:37.857819 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.857805 2562 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 13:47:37.857900 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.857843 2562 server.go:1295] "Started kubelet" Jun 03 13:47:37.857997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.857951 2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 13:47:37.858056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.858015 2562 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 13:47:37.858387 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.858367 2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 13:47:37.858648 ip-10-0-139-48 systemd[1]: Started Kubernetes Kubelet. Jun 03 13:47:37.858856 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.858818 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 13:47:37.859356 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.859280 2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 13:47:37.859422 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.859386 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 13:47:37.859422 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.859387 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 13:47:37.863433 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.863412 2562 server.go:317] "Adding debug handlers to kubelet server" Jun 03 13:47:37.865497 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.865480 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 13:47:37.866190 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.866175 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 13:47:37.866345 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.866329 2562 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 13:47:37.866403 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.866348 2562 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 13:47:37.866478 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.866330 2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 13:47:37.866579 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.866536 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 03 13:47:37.866579 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.866544 2562 reconciler.go:26] "Reconciler: start to sync state" Jun 03 13:47:37.867151 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.867132 2562 factory.go:55] Registering systemd factory Jun 03 13:47:37.867242 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.867177 2562 factory.go:223] Registration of the systemd container factory successfully Jun 03 13:47:37.868651 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.868629 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:37.868820 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.868800 2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 13:47:37.869056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.869041 2562 factory.go:153] Registering CRI-O factory Jun 03 13:47:37.869129 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.869059 2562 factory.go:223] Registration of the crio container factory successfully Jun 03 13:47:37.869129 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.869113 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 13:47:37.869239 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.869132 2562 factory.go:103] Registering Raw factory Jun 03 13:47:37.869239 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.869150 2562 manager.go:1196] Started watching for new ooms in manager Jun 03 13:47:37.869526 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.869514 2562 manager.go:319] Starting recovery of all containers Jun 03 13:47:37.873370 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.873340 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 13:47:37.873478 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.873457 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 13:47:37.874832 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.873613 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18b59646a52ab7c6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-06-03 13:47:37.857816518 +0000 UTC m=+0.470221825,LastTimestamp:2026-06-03 13:47:37.857816518 +0000 UTC m=+0.470221825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}" Jun 03 13:47:37.878628 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.878610 2562 manager.go:324] Recovery completed Jun 03 13:47:37.883418 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.883397 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j2bd4" Jun 03 13:47:37.883859 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.883847 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:47:37.885886 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.885870 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:47:37.885950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.885899 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:47:37.885950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.885910 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:47:37.886386 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.886361 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 13:47:37.886386 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.886376 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 13:47:37.886503 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.886396 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 03 13:47:37.888568 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.888554 2562 policy_none.go:49] "None policy: Start" Jun 03 13:47:37.888632 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.888573 2562 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 13:47:37.888632 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.888587 2562 state_mem.go:35] "Initializing new in-memory state store" Jun 03 13:47:37.888877 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.888322 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18b59646a6d7030a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-06-03 13:47:37.885885194 +0000 UTC m=+0.498290501,LastTimestamp:2026-06-03 13:47:37.885885194 +0000 UTC m=+0.498290501,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}" Jun 03 13:47:37.893492 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.893474 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j2bd4" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.927936 2562 manager.go:341] "Starting Device Plugin manager" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.927982 2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.928000 2562 server.go:85] "Starting device plugin registration server" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.928411 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.928431 2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.928745 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.928819 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.928827 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.930519 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 13:47:37.933347 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.930569 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:37.992507 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.992456 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 13:47:37.993767 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.993741 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 13:47:37.993767 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.993771 2562 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 13:47:37.993957 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.993791 2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 13:47:37.993957 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.993800 2562 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 13:47:37.993957 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:37.993896 2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 13:47:37.999348 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:37.999283 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:47:38.029267 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.029235 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:47:38.031069 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.031050 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:47:38.031169 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.031097 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:47:38.031169 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.031108 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:47:38.031169 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.031132 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.045168 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.045141 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.045168 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.045169 2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-48.ec2.internal\": node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.086416 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.086382 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.094117 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.094092 2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"] Jun 03 13:47:38.094187 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.094167 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:47:38.095765 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.095751 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:47:38.095881 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.095779 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:47:38.095881 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.095800 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:47:38.096996 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.096983 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:47:38.097157 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.097143 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.097209 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.097173 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:47:38.097702 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.097686 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:47:38.097776 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.097713 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:47:38.097776 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.097724 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:47:38.099414 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.099398 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:47:38.099492 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.099423 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:47:38.099492 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.099436 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:47:38.100636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.100618 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.100714 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.100651 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:47:38.101372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.101349 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:47:38.101454 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.101381 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:47:38.101454 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.101391 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:47:38.128096 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.128071 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-48.ec2.internal\" not found" node="ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.132417 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.132393 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-48.ec2.internal\" not found" node="ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.167678 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.167641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a38671be153c2d4d2220cadc6bb89d3b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"a38671be153c2d4d2220cadc6bb89d3b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.167678 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.167674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d239ec7a4b09f2046ae1038f18515b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"0d239ec7a4b09f2046ae1038f18515b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.167862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.167702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d239ec7a4b09f2046ae1038f18515b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"0d239ec7a4b09f2046ae1038f18515b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.187475 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.187442 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.268204 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.268115 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d239ec7a4b09f2046ae1038f18515b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"0d239ec7a4b09f2046ae1038f18515b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.268204 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.268152 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d239ec7a4b09f2046ae1038f18515b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"0d239ec7a4b09f2046ae1038f18515b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.268204 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.268168 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a38671be153c2d4d2220cadc6bb89d3b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"a38671be153c2d4d2220cadc6bb89d3b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.268424 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.268235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a38671be153c2d4d2220cadc6bb89d3b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"a38671be153c2d4d2220cadc6bb89d3b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.268424 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.268246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d239ec7a4b09f2046ae1038f18515b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"0d239ec7a4b09f2046ae1038f18515b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.268424 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.268296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d239ec7a4b09f2046ae1038f18515b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"0d239ec7a4b09f2046ae1038f18515b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.287912 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.287877 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.388634 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.388586 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.430765 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.430738 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.437372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.437354 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" Jun 03 13:47:38.489371 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.489336 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.589878 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.589797 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.690330 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.690291 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.773945 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.773896 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 13:47:38.774652 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.774062 2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 13:47:38.791069 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.791042 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.865813 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.865750 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 13:47:38.878926 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.878891 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 13:47:38.891169 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.891143 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.895376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.895336 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 13:42:37 +0000 UTC" deadline="2027-11-08 08:38:45.861939503 +0000 UTC" Jun 03 13:47:38.895376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.895376 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12546h51m6.966567592s" Jun 03 13:47:38.906937 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.906915 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s2brn" Jun 03 13:47:38.913516 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.913492 2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:47:38.917757 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.917737 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s2brn" Jun 03 13:47:38.967251 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.967198 2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:47:38.982107 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:38.981934 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d239ec7a4b09f2046ae1038f18515b7.slice/crio-9412b6ed6d70bc53ced0f84b8edb04434142905062a6b868b5c18e1662ecfc25 WatchSource:0}: Error finding container 9412b6ed6d70bc53ced0f84b8edb04434142905062a6b868b5c18e1662ecfc25: Status 404 returned error can't find the container with id 9412b6ed6d70bc53ced0f84b8edb04434142905062a6b868b5c18e1662ecfc25 Jun 03 13:47:38.982382 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:38.982361 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38671be153c2d4d2220cadc6bb89d3b.slice/crio-3cf7944fd9b61ba85683305714b9a53e5680679ac1ac66c851b168b868a6b138 WatchSource:0}: Error finding container 3cf7944fd9b61ba85683305714b9a53e5680679ac1ac66c851b168b868a6b138: Status 404 returned error can't find the container with id 3cf7944fd9b61ba85683305714b9a53e5680679ac1ac66c851b168b868a6b138 Jun 03 13:47:38.986265 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.986249 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 13:47:38.991978 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:38.991955 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:38.997126 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.997088 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"0d239ec7a4b09f2046ae1038f18515b7","Type":"ContainerStarted","Data":"9412b6ed6d70bc53ced0f84b8edb04434142905062a6b868b5c18e1662ecfc25"} Jun 03 13:47:38.998130 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:38.998099 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" event={"ID":"a38671be153c2d4d2220cadc6bb89d3b","Type":"ContainerStarted","Data":"3cf7944fd9b61ba85683305714b9a53e5680679ac1ac66c851b168b868a6b138"} Jun 03 13:47:39.092627 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.092595 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:39.193098 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.193063 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:39.293580 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.293537 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found" Jun 03 13:47:39.352573 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.352544 2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:47:39.366427 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.366388 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" Jun 03 13:47:39.387310 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.387282 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 13:47:39.388053 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.388039 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" Jun 03 13:47:39.395679 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.395659 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 13:47:39.844913 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.844874 2562 apiserver.go:52] "Watching apiserver" Jun 03 13:47:39.855257 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.854968 2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 13:47:39.855929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.855879 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-tcn5x","openshift-network-diagnostics/network-check-target-btzh4","openshift-network-operator/iptables-alerter-8xpgd","openshift-cluster-node-tuning-operator/tuned-m9rts","openshift-dns/node-resolver-jkfbn","openshift-image-registry/node-ca-m2lrw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal","openshift-multus/multus-additional-cni-plugins-9vgdg","openshift-multus/multus-pdhlf","openshift-ovn-kubernetes/ovnkube-node-nngck","kube-system/konnectivity-agent-xdfnh","kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g"] Jun 03 13:47:39.859768 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.859741 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.861195 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.860938 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:39.861195 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.861020 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:39.862352 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.862317 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.862462 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.862409 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.862963 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.862922 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 13:47:39.863056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.862996 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gdsm\"" Jun 03 13:47:39.863056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.862950 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 13:47:39.864003 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.863968 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 13:47:39.864101 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.864015 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 13:47:39.864155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.864145 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 13:47:39.864265 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.864234 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 13:47:39.865636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.864949 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.865636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.865586 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 13:47:39.866279 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.866257 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 13:47:39.866497 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.866476 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.867775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.867351 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 13:47:39.867775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.867411 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 13:47:39.867775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.867622 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:47:39.867775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.867627 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qrht7\"" Jun 03 13:47:39.867775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.867741 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:47:39.868061 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.867913 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 13:47:39.868061 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.868022 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mvdbx\"" Jun 03 13:47:39.868157 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.868115 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.868207 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.868193 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p5lq9\"" Jun 03 13:47:39.869111 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.869090 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 13:47:39.869234 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.869203 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cxgq9\"" Jun 03 13:47:39.869378 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.869359 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 13:47:39.869459 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.869441 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.869611 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.869595 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:39.869723 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.869677 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:39.871183 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.871063 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:39.871811 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.871794 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 13:47:39.871892 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.871835 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 13:47:39.871988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.871973 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 13:47:39.872163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.872150 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 13:47:39.872337 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.872322 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lx7pw\"" Jun 03 13:47:39.872386 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.872347 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 13:47:39.872695 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.872604 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 13:47:39.872828 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.872801 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.873014 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.872988 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 13:47:39.873539 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.873521 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bpr6h\"" Jun 03 13:47:39.874113 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.874095 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fgkx6\"" Jun 03 13:47:39.874462 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.874424 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 13:47:39.874693 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.874599 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 13:47:39.875480 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.875459 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 13:47:39.875726 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.875709 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 13:47:39.876273 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.876255 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bf27v\"" Jun 03 13:47:39.876355 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.876264 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 13:47:39.877579 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:39.877668 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-system-cni-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.877668 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-os-release\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.877775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eeadb40e-34f6-4b31-98d1-84c1b0680f33-cni-binary-copy\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.877775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2klp\" (UniqueName: \"kubernetes.io/projected/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-kube-api-access-k2klp\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.877775 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-cnibin\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.877915 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-sys\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.877915 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38dfa819-7f03-4637-887f-646826424ca2-hosts-file\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.877915 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-systemd-units\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.877915 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-var-lib-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878098 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-kubernetes\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.878098 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.877963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysctl-conf\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.878098 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.878098 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-kubelet\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.878098 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-systemd\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878098 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovnkube-config\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-run\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7gj\" (UniqueName: \"kubernetes.io/projected/109bad97-7fca-48bb-8f96-b96090b30407-kube-api-access-lc7gj\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvbtt\" (UniqueName: \"kubernetes.io/projected/eeadb40e-34f6-4b31-98d1-84c1b0680f33-kube-api-access-bvbtt\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-cni-bin\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878335 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-os-release\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.878372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/109bad97-7fca-48bb-8f96-b96090b30407-serviceca\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-netns\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-cni-bin\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-multus-certs\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovn-node-metrics-cert\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysctl-d\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89849\" (UniqueName: \"kubernetes.io/projected/7a390c6c-ff4b-4b71-a0c1-4c2218913841-kube-api-access-89849\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/109bad97-7fca-48bb-8f96-b96090b30407-host\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-socket-dir-parent\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-conf-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-ovn\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-env-overrides\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zld84\" (UniqueName: \"kubernetes.io/projected/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-kube-api-access-zld84\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.878778 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-iptables-alerter-script\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-daemon-config\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-kubelet\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-tuned\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-cni-netd\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-modprobe-d\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysconfig\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-systemd\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38dfa819-7f03-4637-887f-646826424ca2-tmp-dir\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.878999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hh4b\" (UniqueName: \"kubernetes.io/projected/38dfa819-7f03-4637-887f-646826424ca2-kube-api-access-6hh4b\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-k8s-cni-cncf-io\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.879358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-cni-multus\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-hostroot\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-etc-kubernetes\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a390c6c-ff4b-4b71-a0c1-4c2218913841-tmp\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-system-cni-dir\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-cni-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-run-netns\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-host-slash\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-lib-modules\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-slash\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-node-log\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.879906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-log-socket\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.880478 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.880478 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.879969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgx4g\" (UniqueName: \"kubernetes.io/projected/08e644be-d8f1-4da3-8547-4d189c45819f-kube-api-access-wgx4g\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.880478 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.880001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-cnibin\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.880630 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.880524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovnkube-script-lib\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.880630 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.880584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-var-lib-kubelet\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.880630 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.880616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-host\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.880771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.880659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-etc-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.918546 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.918513 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 13:42:38 +0000 UTC" deadline="2028-02-02 09:58:42.182044463 +0000 UTC" Jun 03 13:47:39.918546 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.918543 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14612h11m2.263504148s" Jun 03 13:47:39.967921 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.967887 2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 13:47:39.981902 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.981870 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-kubelet\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.981902 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.981904 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-tuned\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.981929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-registration-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.981954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.981978 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-cni-netd\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.981988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-kubelet\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982018 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-modprobe-d\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982044 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysconfig\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-cni-netd\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982067 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-systemd\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-systemd\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982121 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38dfa819-7f03-4637-887f-646826424ca2-tmp-dir\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982148 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-modprobe-d\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysconfig\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982151 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hh4b\" (UniqueName: \"kubernetes.io/projected/38dfa819-7f03-4637-887f-646826424ca2-kube-api-access-6hh4b\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982191 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-k8s-cni-cncf-io\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982214 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-cni-multus\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982255 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-hostroot\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982277 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-etc-kubernetes\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-k8s-cni-cncf-io\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982321 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-etc-kubernetes\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982325 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a390c6c-ff4b-4b71-a0c1-4c2218913841-tmp\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-cni-multus\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982367 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-system-cni-dir\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982370 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982407 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-hostroot\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982429 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-cni-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-system-cni-dir\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.982593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38dfa819-7f03-4637-887f-646826424ca2-tmp-dir\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982460 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-run-netns\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-run-netns\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-cni-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982523 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-host-slash\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-host-slash\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982617 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-lib-modules\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982642 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982667 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-slash\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982690 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-node-log\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982713 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-log-socket\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982753 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-lib-modules\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-node-log\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982800 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgx4g\" (UniqueName: \"kubernetes.io/projected/08e644be-d8f1-4da3-8547-4d189c45819f-kube-api-access-wgx4g\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-log-socket\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982824 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-cnibin\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.983376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982826 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-slash\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982857 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovnkube-script-lib\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-cnibin\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982885 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-var-lib-kubelet\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982920 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-host\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982947 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-etc-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-host\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.982979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-var-lib-kubelet\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-socket-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-etc-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983048 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983072 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-system-cni-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983095 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-os-release\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983117 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eeadb40e-34f6-4b31-98d1-84c1b0680f33-cni-binary-copy\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.984071 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983145 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2klp\" (UniqueName: \"kubernetes.io/projected/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-kube-api-access-k2klp\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983168 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-cnibin\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-device-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-sys-fs\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983348 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-cnibin\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-system-cni-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-os-release\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983483 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-sys\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983510 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38dfa819-7f03-4637-887f-646826424ca2-hosts-file\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovnkube-script-lib\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-sys\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983540 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-systemd-units\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-systemd-units\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38dfa819-7f03-4637-887f-646826424ca2-hosts-file\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983620 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-var-lib-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3c9fb08-cc1a-47b5-9dda-81d54bab8b50-agent-certs\") pod \"konnectivity-agent-xdfnh\" (UID: \"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50\") " pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983667 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-kubernetes\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983681 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-var-lib-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.984862 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983691 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysctl-conf\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983727 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-kubernetes\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983755 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983778 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-kubelet\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eeadb40e-34f6-4b31-98d1-84c1b0680f33-cni-binary-copy\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983800 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-systemd\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysctl-conf\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-kubelet\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983829 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovnkube-config\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983876 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-run\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-systemd\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983901 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-run\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrcd7\" (UniqueName: \"kubernetes.io/projected/71840af9-ec32-4970-b9c2-92b8dc8d55fa-kube-api-access-xrcd7\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983963 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7gj\" (UniqueName: \"kubernetes.io/projected/109bad97-7fca-48bb-8f96-b96090b30407-kube-api-access-lc7gj\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.983993 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvbtt\" (UniqueName: \"kubernetes.io/projected/eeadb40e-34f6-4b31-98d1-84c1b0680f33-kube-api-access-bvbtt\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984020 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.985606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984047 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984080 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-cni-bin\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984109 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-os-release\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984135 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9fb08-cc1a-47b5-9dda-81d54bab8b50-konnectivity-ca\") pod \"konnectivity-agent-xdfnh\" (UID: \"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50\") " pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984241 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/109bad97-7fca-48bb-8f96-b96090b30407-serviceca\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984258 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-netns\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984277 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-cni-bin\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984296 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-multus-certs\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984313 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovn-node-metrics-cert\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984328 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysctl-d\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984344 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89849\" (UniqueName: \"kubernetes.io/projected/7a390c6c-ff4b-4b71-a0c1-4c2218913841-kube-api-access-89849\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhs7g\" (UniqueName: \"kubernetes.io/projected/1f95aa13-89ff-4764-80e3-ba2701e0d364-kube-api-access-qhs7g\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984383 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/109bad97-7fca-48bb-8f96-b96090b30407-host\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984416 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-socket-dir-parent\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovnkube-config\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.986400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984436 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-conf-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-netns\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984576 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-conf-dir\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984582 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08e644be-d8f1-4da3-8547-4d189c45819f-os-release\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-openvswitch\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984676 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-run-multus-certs\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-host-cni-bin\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-host-var-lib-cni-bin\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.984980 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-ovn\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985017 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-env-overrides\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985042 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zld84\" (UniqueName: \"kubernetes.io/projected/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-kube-api-access-zld84\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985044 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08e644be-d8f1-4da3-8547-4d189c45819f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985066 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-iptables-alerter-script\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985089 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-daemon-config\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-socket-dir-parent\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987213 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985202 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-run-ovn\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-sysctl-d\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/109bad97-7fca-48bb-8f96-b96090b30407-serviceca\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-iptables-alerter-script\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985744 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a390c6c-ff4b-4b71-a0c1-4c2218913841-etc-tuned\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a390c6c-ff4b-4b71-a0c1-4c2218913841-tmp\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.985873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/109bad97-7fca-48bb-8f96-b96090b30407-host\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.986021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-env-overrides\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.986047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eeadb40e-34f6-4b31-98d1-84c1b0680f33-multus-daemon-config\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.987997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.986946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-ovn-node-metrics-cert\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:39.991634 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.991612 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:47:39.991634 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.991635 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:47:39.992440 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.991648 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2ft7b for pod openshift-network-diagnostics/network-check-target-btzh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:39.992440 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:39.991733 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b podName:97bfe6a5-b893-4801-9178-bd09d95b7f36 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:40.491713991 +0000 UTC m=+3.104119310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2ft7b" (UniqueName: "kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b") pod "network-check-target-btzh4" (UID: "97bfe6a5-b893-4801-9178-bd09d95b7f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:39.993075 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.993053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hh4b\" (UniqueName: \"kubernetes.io/projected/38dfa819-7f03-4637-887f-646826424ca2-kube-api-access-6hh4b\") pod \"node-resolver-jkfbn\" (UID: \"38dfa819-7f03-4637-887f-646826424ca2\") " pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:39.993519 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.993495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgx4g\" (UniqueName: \"kubernetes.io/projected/08e644be-d8f1-4da3-8547-4d189c45819f-kube-api-access-wgx4g\") pod \"multus-additional-cni-plugins-9vgdg\" (UID: \"08e644be-d8f1-4da3-8547-4d189c45819f\") " pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:39.994431 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.994413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2klp\" (UniqueName: \"kubernetes.io/projected/97329ba7-14d9-47c6-b7c4-1d21b85c87c0-kube-api-access-k2klp\") pod \"iptables-alerter-8xpgd\" (UID: \"97329ba7-14d9-47c6-b7c4-1d21b85c87c0\") " pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:39.998347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.998318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7gj\" (UniqueName: \"kubernetes.io/projected/109bad97-7fca-48bb-8f96-b96090b30407-kube-api-access-lc7gj\") pod \"node-ca-m2lrw\" (UID: \"109bad97-7fca-48bb-8f96-b96090b30407\") " pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:39.998558 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.998537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvbtt\" (UniqueName: \"kubernetes.io/projected/eeadb40e-34f6-4b31-98d1-84c1b0680f33-kube-api-access-bvbtt\") pod \"multus-pdhlf\" (UID: \"eeadb40e-34f6-4b31-98d1-84c1b0680f33\") " pod="openshift-multus/multus-pdhlf" Jun 03 13:47:39.999683 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.999659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89849\" (UniqueName: \"kubernetes.io/projected/7a390c6c-ff4b-4b71-a0c1-4c2218913841-kube-api-access-89849\") pod \"tuned-m9rts\" (UID: \"7a390c6c-ff4b-4b71-a0c1-4c2218913841\") " pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:39.999832 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:39.999808 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zld84\" (UniqueName: \"kubernetes.io/projected/4b8ba6fb-bc6e-4cba-a402-7db8544da6fb-kube-api-access-zld84\") pod \"ovnkube-node-nngck\" (UID: \"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:40.086583 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086549 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.086583 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086592 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:40.086771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086610 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-socket-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.086771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086646 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-device-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.086771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.086771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-device-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.086771 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.086701 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:40.086771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086732 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-sys-fs\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.086771 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.086761 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs podName:1f95aa13-89ff-4764-80e3-ba2701e0d364 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:40.586745409 +0000 UTC m=+3.199150703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs") pod "network-metrics-daemon-tcn5x" (UID: "1f95aa13-89ff-4764-80e3-ba2701e0d364") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086783 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3c9fb08-cc1a-47b5-9dda-81d54bab8b50-agent-certs\") pod \"konnectivity-agent-xdfnh\" (UID: \"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50\") " pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-sys-fs\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-socket-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086808 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrcd7\" (UniqueName: \"kubernetes.io/projected/71840af9-ec32-4970-b9c2-92b8dc8d55fa-kube-api-access-xrcd7\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086846 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9fb08-cc1a-47b5-9dda-81d54bab8b50-konnectivity-ca\") pod \"konnectivity-agent-xdfnh\" (UID: \"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50\") " pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086870 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhs7g\" (UniqueName: \"kubernetes.io/projected/1f95aa13-89ff-4764-80e3-ba2701e0d364-kube-api-access-qhs7g\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086906 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-registration-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086928 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-registration-dir\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.087148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.086996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71840af9-ec32-4970-b9c2-92b8dc8d55fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.087617 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.087480 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9fb08-cc1a-47b5-9dda-81d54bab8b50-konnectivity-ca\") pod \"konnectivity-agent-xdfnh\" (UID: \"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50\") " pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:40.089179 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.089152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3c9fb08-cc1a-47b5-9dda-81d54bab8b50-agent-certs\") pod \"konnectivity-agent-xdfnh\" (UID: \"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50\") " pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:40.095603 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.095508 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrcd7\" (UniqueName: \"kubernetes.io/projected/71840af9-ec32-4970-b9c2-92b8dc8d55fa-kube-api-access-xrcd7\") pod \"aws-ebs-csi-driver-node-kg29g\" (UID: \"71840af9-ec32-4970-b9c2-92b8dc8d55fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.096572 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.096540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhs7g\" (UniqueName: \"kubernetes.io/projected/1f95aa13-89ff-4764-80e3-ba2701e0d364-kube-api-access-qhs7g\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:40.179808 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.179773 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:47:40.189735 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.189706 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xpgd" Jun 03 13:47:40.197585 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.197560 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9rts" Jun 03 13:47:40.198972 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.198949 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:47:40.202090 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.202067 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jkfbn" Jun 03 13:47:40.208720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.208699 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2lrw" Jun 03 13:47:40.216198 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.216170 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" Jun 03 13:47:40.223821 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.223798 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pdhlf" Jun 03 13:47:40.230389 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.230369 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:40.234958 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.234938 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" Jun 03 13:47:40.591147 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.591119 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:40.591281 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.591158 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:40.591325 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.591281 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:40.591325 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.591300 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:47:40.591325 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.591313 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:47:40.591325 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.591325 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2ft7b for pod openshift-network-diagnostics/network-check-target-btzh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:40.591444 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.591351 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs podName:1f95aa13-89ff-4764-80e3-ba2701e0d364 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:41.591330941 +0000 UTC m=+4.203736256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs") pod "network-metrics-daemon-tcn5x" (UID: "1f95aa13-89ff-4764-80e3-ba2701e0d364") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:40.591444 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.591369 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b podName:97bfe6a5-b893-4801-9178-bd09d95b7f36 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:41.59135905 +0000 UTC m=+4.203764346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ft7b" (UniqueName: "kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b") pod "network-check-target-btzh4" (UID: "97bfe6a5-b893-4801-9178-bd09d95b7f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:40.599714 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.599639 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8ba6fb_bc6e_4cba_a402_7db8544da6fb.slice/crio-cfbeeefbb814e6c253fc66b195a079c080feafd1a751a341586f61722af36db2 WatchSource:0}: Error finding container cfbeeefbb814e6c253fc66b195a079c080feafd1a751a341586f61722af36db2: Status 404 returned error can't find the container with id cfbeeefbb814e6c253fc66b195a079c080feafd1a751a341586f61722af36db2 Jun 03 13:47:40.601857 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.601338 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71840af9_ec32_4970_b9c2_92b8dc8d55fa.slice/crio-0a9273bb82e5c4b9f91eb9d6b146c7e6e0f315f2b591659094299115537ce529 WatchSource:0}: Error finding container 0a9273bb82e5c4b9f91eb9d6b146c7e6e0f315f2b591659094299115537ce529: Status 404 returned error can't find the container with id 0a9273bb82e5c4b9f91eb9d6b146c7e6e0f315f2b591659094299115537ce529 Jun 03 13:47:40.603917 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.603896 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a390c6c_ff4b_4b71_a0c1_4c2218913841.slice/crio-20a0a115183d220a401189c1d52c8b7bfacb94422a28b0beb98867bbdfb03602 WatchSource:0}: Error finding container 20a0a115183d220a401189c1d52c8b7bfacb94422a28b0beb98867bbdfb03602: Status 404 returned error can't find the container with id 20a0a115183d220a401189c1d52c8b7bfacb94422a28b0beb98867bbdfb03602 Jun 03 13:47:40.604730 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.604702 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeadb40e_34f6_4b31_98d1_84c1b0680f33.slice/crio-b5b49bada77f65aad7330cf3c183fa9e80518bbf664163e32e10688c86b01c3a WatchSource:0}: Error finding container b5b49bada77f65aad7330cf3c183fa9e80518bbf664163e32e10688c86b01c3a: Status 404 returned error can't find the container with id b5b49bada77f65aad7330cf3c183fa9e80518bbf664163e32e10688c86b01c3a Jun 03 13:47:40.605681 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.605599 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109bad97_7fca_48bb_8f96_b96090b30407.slice/crio-d136180fac620d293ee331d04cf2a437a3efbb23701134434bb76c9698b2096d WatchSource:0}: Error finding container d136180fac620d293ee331d04cf2a437a3efbb23701134434bb76c9698b2096d: Status 404 returned error can't find the container with id d136180fac620d293ee331d04cf2a437a3efbb23701134434bb76c9698b2096d Jun 03 13:47:40.608012 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.607294 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38dfa819_7f03_4637_887f_646826424ca2.slice/crio-2141a483ef2448a96cf561b00bd1d65847a5f3ee3253d98933323b36f8c941de WatchSource:0}: Error finding container 2141a483ef2448a96cf561b00bd1d65847a5f3ee3253d98933323b36f8c941de: Status 404 returned error can't find the container with id 2141a483ef2448a96cf561b00bd1d65847a5f3ee3253d98933323b36f8c941de Jun 03 13:47:40.608012 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.607810 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e644be_d8f1_4da3_8547_4d189c45819f.slice/crio-1ca71b077a413d581fb50cf2b81c9d1d2019a2f5682df07586e62d02b060544a WatchSource:0}: Error finding container 1ca71b077a413d581fb50cf2b81c9d1d2019a2f5682df07586e62d02b060544a: Status 404 returned error can't find the container with id 1ca71b077a413d581fb50cf2b81c9d1d2019a2f5682df07586e62d02b060544a Jun 03 13:47:40.608959 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.608559 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97329ba7_14d9_47c6_b7c4_1d21b85c87c0.slice/crio-8b607bde378b18fb61f83996c76a168a14a54ec58323d97988fd0746e809fab2 WatchSource:0}: Error finding container 8b607bde378b18fb61f83996c76a168a14a54ec58323d97988fd0746e809fab2: Status 404 returned error can't find the container with id 8b607bde378b18fb61f83996c76a168a14a54ec58323d97988fd0746e809fab2 Jun 03 13:47:40.609429 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:47:40.609151 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c9fb08_cc1a_47b5_9dda_81d54bab8b50.slice/crio-c5387437885e8b6df1a37bbf337f29a1789a38a6d84313ae879b3ba778afbb3a WatchSource:0}: Error finding container c5387437885e8b6df1a37bbf337f29a1789a38a6d84313ae879b3ba778afbb3a: Status 404 returned error can't find the container with id c5387437885e8b6df1a37bbf337f29a1789a38a6d84313ae879b3ba778afbb3a Jun 03 13:47:40.918995 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.918962 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 13:42:38 +0000 UTC" deadline="2027-10-29 03:33:41.106279206 +0000 UTC" Jun 03 13:47:40.918995 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.918993 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12301h46m0.187288888s" Jun 03 13:47:40.994507 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:40.994473 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:40.994667 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:40.994616 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:41.004746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.004692 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jkfbn" event={"ID":"38dfa819-7f03-4637-887f-646826424ca2","Type":"ContainerStarted","Data":"2141a483ef2448a96cf561b00bd1d65847a5f3ee3253d98933323b36f8c941de"} Jun 03 13:47:41.006337 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.006305 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" event={"ID":"71840af9-ec32-4970-b9c2-92b8dc8d55fa","Type":"ContainerStarted","Data":"0a9273bb82e5c4b9f91eb9d6b146c7e6e0f315f2b591659094299115537ce529"} Jun 03 13:47:41.007690 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.007663 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xdfnh" event={"ID":"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50","Type":"ContainerStarted","Data":"c5387437885e8b6df1a37bbf337f29a1789a38a6d84313ae879b3ba778afbb3a"} Jun 03 13:47:41.008852 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.008801 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xpgd" event={"ID":"97329ba7-14d9-47c6-b7c4-1d21b85c87c0","Type":"ContainerStarted","Data":"8b607bde378b18fb61f83996c76a168a14a54ec58323d97988fd0746e809fab2"} Jun 03 13:47:41.009956 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.009867 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2lrw" event={"ID":"109bad97-7fca-48bb-8f96-b96090b30407","Type":"ContainerStarted","Data":"d136180fac620d293ee331d04cf2a437a3efbb23701134434bb76c9698b2096d"} Jun 03 13:47:41.011108 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.011044 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pdhlf" event={"ID":"eeadb40e-34f6-4b31-98d1-84c1b0680f33","Type":"ContainerStarted","Data":"b5b49bada77f65aad7330cf3c183fa9e80518bbf664163e32e10688c86b01c3a"} Jun 03 13:47:41.012441 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.012419 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9rts" event={"ID":"7a390c6c-ff4b-4b71-a0c1-4c2218913841","Type":"ContainerStarted","Data":"20a0a115183d220a401189c1d52c8b7bfacb94422a28b0beb98867bbdfb03602"} Jun 03 13:47:41.013663 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.013639 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"cfbeeefbb814e6c253fc66b195a079c080feafd1a751a341586f61722af36db2"} Jun 03 13:47:41.017012 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.016349 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" event={"ID":"a38671be153c2d4d2220cadc6bb89d3b","Type":"ContainerStarted","Data":"14a643e94b84e282c758cb2cbec95c92249c61fb384133873a2b48f84c4d55dd"} Jun 03 13:47:41.021435 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.021382 2562 generic.go:358] "Generic (PLEG): container finished" podID="0d239ec7a4b09f2046ae1038f18515b7" containerID="97597cd854a7ac2bade0ba9908d1fbab0d7cb1bacad46a702a51cbfd5a54e702" exitCode=0 Jun 03 13:47:41.021545 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.021459 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"0d239ec7a4b09f2046ae1038f18515b7","Type":"ContainerDied","Data":"97597cd854a7ac2bade0ba9908d1fbab0d7cb1bacad46a702a51cbfd5a54e702"} Jun 03 13:47:41.027373 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.027333 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerStarted","Data":"1ca71b077a413d581fb50cf2b81c9d1d2019a2f5682df07586e62d02b060544a"} Jun 03 13:47:41.053760 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.053126 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" podStartSLOduration=2.053105095 podStartE2EDuration="2.053105095s" podCreationTimestamp="2026-06-03 13:47:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:47:41.035238527 +0000 UTC m=+3.647643839" watchObservedRunningTime="2026-06-03 13:47:41.053105095 +0000 UTC m=+3.665510418" Jun 03 13:47:41.603676 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.603577 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:41.603676 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.603628 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:41.603914 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:41.603748 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:41.603914 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:41.603767 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:47:41.603914 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:41.603784 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:47:41.603914 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:41.603796 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2ft7b for pod openshift-network-diagnostics/network-check-target-btzh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:41.603914 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:41.603823 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs podName:1f95aa13-89ff-4764-80e3-ba2701e0d364 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:43.603802943 +0000 UTC m=+6.216208251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs") pod "network-metrics-daemon-tcn5x" (UID: "1f95aa13-89ff-4764-80e3-ba2701e0d364") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:41.603914 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:41.603845 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b podName:97bfe6a5-b893-4801-9178-bd09d95b7f36 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:43.603834419 +0000 UTC m=+6.216239713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ft7b" (UniqueName: "kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b") pod "network-check-target-btzh4" (UID: "97bfe6a5-b893-4801-9178-bd09d95b7f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:41.996528 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:41.996495 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:41.996984 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:41.996627 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:42.054686 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:42.054627 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"0d239ec7a4b09f2046ae1038f18515b7","Type":"ContainerStarted","Data":"b55655f7dc5f40980b51d55d24c8aca920749569fde033b7ea570f34817245be"} Jun 03 13:47:42.070469 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:42.070423 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" podStartSLOduration=3.070407359 podStartE2EDuration="3.070407359s" podCreationTimestamp="2026-06-03 13:47:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:47:42.070361649 +0000 UTC m=+4.682766966" watchObservedRunningTime="2026-06-03 13:47:42.070407359 +0000 UTC m=+4.682812674" Jun 03 13:47:42.995975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:42.994543 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:42.995975 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:42.994701 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:43.619984 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:43.620034 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:43.620204 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:43.620236 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:43.620249 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2ft7b for pod openshift-network-diagnostics/network-check-target-btzh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:43.620312 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b podName:97bfe6a5-b893-4801-9178-bd09d95b7f36 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:47.620293532 +0000 UTC m=+10.232698831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ft7b" (UniqueName: "kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b") pod "network-check-target-btzh4" (UID: "97bfe6a5-b893-4801-9178-bd09d95b7f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:43.620324 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:43.620535 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:43.620402 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs podName:1f95aa13-89ff-4764-80e3-ba2701e0d364 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:47.620373136 +0000 UTC m=+10.232778435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs") pod "network-metrics-daemon-tcn5x" (UID: "1f95aa13-89ff-4764-80e3-ba2701e0d364") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:43.998425 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:43.997942 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:43.998425 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:43.998063 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:44.994406 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:44.994370 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:44.994884 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:44.994525 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:45.994925 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:45.994890 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:45.995419 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:45.995031 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:46.995314 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:46.994919 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:46.995314 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:46.995068 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:47.651159 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:47.651087 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:47.651159 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:47.651134 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:47.651452 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:47.651271 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:47.651452 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:47.651323 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:47:47.651452 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:47.651342 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:47:47.651452 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:47.651346 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs podName:1f95aa13-89ff-4764-80e3-ba2701e0d364 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:55.651326417 +0000 UTC m=+18.263731727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs") pod "network-metrics-daemon-tcn5x" (UID: "1f95aa13-89ff-4764-80e3-ba2701e0d364") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:47.651452 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:47.651353 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2ft7b for pod openshift-network-diagnostics/network-check-target-btzh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:47.651452 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:47.651405 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b podName:97bfe6a5-b893-4801-9178-bd09d95b7f36 nodeName:}" failed. No retries permitted until 2026-06-03 13:47:55.651387525 +0000 UTC m=+18.263792825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ft7b" (UniqueName: "kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b") pod "network-check-target-btzh4" (UID: "97bfe6a5-b893-4801-9178-bd09d95b7f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:47.997752 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:47.997727 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:47.998237 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:47.997815 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:48.994806 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:48.994699 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:48.994980 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:48.994842 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:49.994928 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:49.994890 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:49.995328 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:49.995022 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:50.994792 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:50.994751 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:50.994991 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:50.994882 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:51.994525 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:51.994485 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:51.994722 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:51.994613 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:52.994410 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:52.994368 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:52.994846 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:52.994505 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:53.994329 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:53.994292 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:53.994502 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:53.994427 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:54.994584 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:54.994550 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:54.995058 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:54.994689 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:55.714674 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:55.714637 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:55.714961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:55.714682 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:55.714961 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:55.714802 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:55.714961 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:55.714815 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:47:55.714961 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:55.714832 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:47:55.714961 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:55.714843 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2ft7b for pod openshift-network-diagnostics/network-check-target-btzh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:55.714961 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:55.714880 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs podName:1f95aa13-89ff-4764-80e3-ba2701e0d364 nodeName:}" failed. No retries permitted until 2026-06-03 13:48:11.714856153 +0000 UTC m=+34.327261448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs") pod "network-metrics-daemon-tcn5x" (UID: "1f95aa13-89ff-4764-80e3-ba2701e0d364") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:47:55.714961 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:55.714902 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b podName:97bfe6a5-b893-4801-9178-bd09d95b7f36 nodeName:}" failed. No retries permitted until 2026-06-03 13:48:11.714892138 +0000 UTC m=+34.327297435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ft7b" (UniqueName: "kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b") pod "network-check-target-btzh4" (UID: "97bfe6a5-b893-4801-9178-bd09d95b7f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:47:55.994606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:55.994529 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:55.995023 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:55.994639 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:56.994907 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:56.994872 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:56.995359 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:56.994997 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:57.995607 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:57.995351 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:57.996043 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:57.995699 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:47:58.994926 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:58.994901 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:47:58.995016 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:58.995001 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:47:59.088971 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.088946 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pdhlf" event={"ID":"eeadb40e-34f6-4b31-98d1-84c1b0680f33","Type":"ContainerStarted","Data":"97003c1a0ef7a1d11af3ff0e0b396793e10badb7468a2b3f0169af63a5d4e357"} Jun 03 13:47:59.090132 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.090104 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9rts" event={"ID":"7a390c6c-ff4b-4b71-a0c1-4c2218913841","Type":"ContainerStarted","Data":"59c7dd26a7320194253b8be36191b8de79ed08ce8a713e9a37958904aefee848"} Jun 03 13:47:59.091951 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.091931 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"f19cadc4f15fa4c7fb68f7be27b7802ca98aa2e513c305869a798ca93b22c8a0"} Jun 03 13:47:59.092049 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.091956 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"c2ccc0326945dda4a7339f82f9e93217da18f167b3fbbe6621ca0d781d6bbd8e"} Jun 03 13:47:59.092049 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.091971 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"7ade22df3f1cbbb983d387a70816b5b1823e42e81cb69a8ad0af446cc6c73c71"} Jun 03 13:47:59.092049 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.091983 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"4495281ee56d97580228cd729e8ab88126be17fcdf4835918899f6f2eb170cf9"} Jun 03 13:47:59.093158 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.093134 2562 generic.go:358] "Generic (PLEG): container finished" podID="08e644be-d8f1-4da3-8547-4d189c45819f" containerID="42e595e1d0f29c0931d37c92e25fe3f9acefe292fb24f357ff53ad1a5a53e079" exitCode=0 Jun 03 13:47:59.093263 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.093199 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerDied","Data":"42e595e1d0f29c0931d37c92e25fe3f9acefe292fb24f357ff53ad1a5a53e079"} Jun 03 13:47:59.094842 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.094818 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jkfbn" event={"ID":"38dfa819-7f03-4637-887f-646826424ca2","Type":"ContainerStarted","Data":"e4c08db12ae5464c143173df18341928b4dfd8819153b1b9b00cd32c52c67b48"} Jun 03 13:47:59.098291 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.098253 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" event={"ID":"71840af9-ec32-4970-b9c2-92b8dc8d55fa","Type":"ContainerStarted","Data":"1957039aa4a09f61274f90af5035565335a5a38c90a89b8d837fd54739519d23"} Jun 03 13:47:59.099496 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.099473 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xdfnh" event={"ID":"b3c9fb08-cc1a-47b5-9dda-81d54bab8b50","Type":"ContainerStarted","Data":"a74c0a564ee91578404a619f9059cfdc8e45f253e310e926dedffb4879cada62"} Jun 03 13:47:59.100759 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.100739 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2lrw" event={"ID":"109bad97-7fca-48bb-8f96-b96090b30407","Type":"ContainerStarted","Data":"38fcaacb37d77d041a893256dc59fe8b262f09552dbbc016e3d06ad3e348ef78"} Jun 03 13:47:59.150671 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.150631 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pdhlf" podStartSLOduration=3.148162022 podStartE2EDuration="21.150617649s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.606689029 +0000 UTC m=+3.219094322" lastFinishedPulling="2026-06-03 13:47:58.60914464 +0000 UTC m=+21.221549949" observedRunningTime="2026-06-03 13:47:59.117929344 +0000 UTC m=+21.730334657" watchObservedRunningTime="2026-06-03 13:47:59.150617649 +0000 UTC m=+21.763022969" Jun 03 13:47:59.168899 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.168859 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xdfnh" podStartSLOduration=11.082652238 podStartE2EDuration="21.168846558s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.611151552 +0000 UTC m=+3.223556851" lastFinishedPulling="2026-06-03 13:47:50.697345874 +0000 UTC m=+13.309751171" observedRunningTime="2026-06-03 13:47:59.168310559 +0000 UTC m=+21.780715890" watchObservedRunningTime="2026-06-03 13:47:59.168846558 +0000 UTC m=+21.781251874" Jun 03 13:47:59.180262 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.180238 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:59.180759 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.180743 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:47:59.184233 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.184185 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jkfbn" podStartSLOduration=3.214981558 podStartE2EDuration="21.184173907s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.609821511 +0000 UTC m=+3.222226820" lastFinishedPulling="2026-06-03 13:47:58.579013859 +0000 UTC m=+21.191419169" observedRunningTime="2026-06-03 13:47:59.183619657 +0000 UTC m=+21.796024972" watchObservedRunningTime="2026-06-03 13:47:59.184173907 +0000 UTC m=+21.796579222" Jun 03 13:47:59.227662 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.227611 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m2lrw" podStartSLOduration=3.255893149 podStartE2EDuration="21.227597473s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.607654609 +0000 UTC m=+3.220059903" lastFinishedPulling="2026-06-03 13:47:58.579358921 +0000 UTC m=+21.191764227" observedRunningTime="2026-06-03 13:47:59.22757706 +0000 UTC m=+21.839982376" watchObservedRunningTime="2026-06-03 13:47:59.227597473 +0000 UTC m=+21.840002789" Jun 03 13:47:59.228240 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.228191 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m9rts" podStartSLOduration=3.253049533 podStartE2EDuration="21.228182837s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.605793738 +0000 UTC m=+3.218199042" lastFinishedPulling="2026-06-03 13:47:58.580927039 +0000 UTC m=+21.193332346" observedRunningTime="2026-06-03 13:47:59.211327659 +0000 UTC m=+21.823732974" watchObservedRunningTime="2026-06-03 13:47:59.228182837 +0000 UTC m=+21.840588153" Jun 03 13:47:59.994685 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:47:59.994658 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:47:59.994854 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:47:59.994788 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:00.102555 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.102320 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 13:48:00.105383 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.105353 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" event={"ID":"71840af9-ec32-4970-b9c2-92b8dc8d55fa","Type":"ContainerStarted","Data":"cda419621a4c8b557dea882a16f2d8d4cf9687fd4f04bf76ca7467780cc5f3c4"} Jun 03 13:48:00.109303 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.109242 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"a984e100839318839435113712b5aeb911adb7698d539b1a62177bf33e586ddf"} Jun 03 13:48:00.109303 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.109280 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"4d6427bfb5eb7d3789d176651a31857ad04fe4bb58f62a8c42fc99bf3249234f"} Jun 03 13:48:00.941437 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.941308 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T13:48:00.102533174Z","UUID":"4ab716d1-3e7c-4672-a21b-ba608f9f48e2","Handler":null,"Name":"","Endpoint":""} Jun 03 13:48:00.943424 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.943396 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 13:48:00.943568 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.943431 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 13:48:00.994270 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:00.994233 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:00.994470 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:00.994366 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:01.112999 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:01.112962 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xpgd" event={"ID":"97329ba7-14d9-47c6-b7c4-1d21b85c87c0","Type":"ContainerStarted","Data":"d85b75ffcf8cefd28062687ad89de43925e28322557ab783015db350c90016d0"} Jun 03 13:48:01.113480 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:01.113450 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 13:48:01.130025 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:01.129970 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8xpgd" podStartSLOduration=5.160649744 podStartE2EDuration="23.129951055s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.610082728 +0000 UTC m=+3.222488036" lastFinishedPulling="2026-06-03 13:47:58.579384037 +0000 UTC m=+21.191789347" observedRunningTime="2026-06-03 13:48:01.12931597 +0000 UTC m=+23.741721285" watchObservedRunningTime="2026-06-03 13:48:01.129951055 +0000 UTC m=+23.742356374" Jun 03 13:48:01.994650 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:01.994611 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:01.994834 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:01.994725 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:02.116915 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:02.116834 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" event={"ID":"71840af9-ec32-4970-b9c2-92b8dc8d55fa","Type":"ContainerStarted","Data":"875c36aa6c0f50b037dcef21c99327c5bc55f6bc3d2924ee1b8e2bea68bfb549"} Jun 03 13:48:02.120033 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:02.120002 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"c372b6107ebe0e4e54351e57b8905c6a5ef58b68473aa9a9096630da77d55462"} Jun 03 13:48:02.143917 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:02.143868 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kg29g" podStartSLOduration=3.447166518 podStartE2EDuration="24.143853834s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.603408786 +0000 UTC m=+3.215814093" lastFinishedPulling="2026-06-03 13:48:01.300096115 +0000 UTC m=+23.912501409" observedRunningTime="2026-06-03 13:48:02.143646189 +0000 UTC m=+24.756051505" watchObservedRunningTime="2026-06-03 13:48:02.143853834 +0000 UTC m=+24.756259149" Jun 03 13:48:02.994281 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:02.994243 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:02.994462 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:02.994375 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:03.513597 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:03.513572 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jkfbn_38dfa819-7f03-4637-887f-646826424ca2/dns-node-resolver/0.log" Jun 03 13:48:03.996522 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:03.994813 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:03.996522 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:03.995153 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:04.127525 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:04.127491 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" event={"ID":"4b8ba6fb-bc6e-4cba-a402-7db8544da6fb","Type":"ContainerStarted","Data":"f5c4edb7e260e012eb7c2cb2309e0996f4cefff5e859bd2f0d1cac15927e90ee"} Jun 03 13:48:04.127897 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:04.127874 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:48:04.129272 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:04.129249 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerStarted","Data":"0d91aca48a17835f8c864db88ecf0a48aad7eb7d9f6e2cc173499c40ae751fc6"} Jun 03 13:48:04.143831 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:04.143809 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:48:04.161847 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:04.161803 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" podStartSLOduration=7.985224378 podStartE2EDuration="26.161789114s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.60226893 +0000 UTC m=+3.214674238" lastFinishedPulling="2026-06-03 13:47:58.778833673 +0000 UTC m=+21.391238974" observedRunningTime="2026-06-03 13:48:04.161500202 +0000 UTC m=+26.773905518" watchObservedRunningTime="2026-06-03 13:48:04.161789114 +0000 UTC m=+26.774194479" Jun 03 13:48:04.490860 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:04.490830 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2lrw_109bad97-7fca-48bb-8f96-b96090b30407/node-ca/0.log" Jun 03 13:48:04.994906 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:04.994866 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:04.995470 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:04.995022 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:05.133432 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:05.133393 2562 generic.go:358] "Generic (PLEG): container finished" podID="08e644be-d8f1-4da3-8547-4d189c45819f" containerID="0d91aca48a17835f8c864db88ecf0a48aad7eb7d9f6e2cc173499c40ae751fc6" exitCode=0 Jun 03 13:48:05.133616 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:05.133489 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerDied","Data":"0d91aca48a17835f8c864db88ecf0a48aad7eb7d9f6e2cc173499c40ae751fc6"} Jun 03 13:48:05.133616 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:05.133579 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 13:48:05.134135 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:05.134115 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:48:05.155607 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:05.155571 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:48:05.994100 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:05.994075 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:05.994212 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:05.994179 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:06.137529 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:06.137296 2562 generic.go:358] "Generic (PLEG): container finished" podID="08e644be-d8f1-4da3-8547-4d189c45819f" containerID="0f4038957592ba4c4db47afa116d0df755877288feac16f3474ba0614d2407c6" exitCode=0 Jun 03 13:48:06.137869 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:06.137381 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerDied","Data":"0f4038957592ba4c4db47afa116d0df755877288feac16f3474ba0614d2407c6"} Jun 03 13:48:06.137869 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:06.137640 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 13:48:06.234907 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:06.234876 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcn5x"] Jun 03 13:48:06.235067 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:06.235029 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:06.235178 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:06.235155 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:06.238235 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:06.238194 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-btzh4"] Jun 03 13:48:06.238350 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:06.238301 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:06.238414 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:06.238392 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:07.141498 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:07.141407 2562 generic.go:358] "Generic (PLEG): container finished" podID="08e644be-d8f1-4da3-8547-4d189c45819f" containerID="7787c20da52ee24135b5161436eff9b900548c57f00b0a7ac0cda40368634e1b" exitCode=0 Jun 03 13:48:07.141498 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:07.141476 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerDied","Data":"7787c20da52ee24135b5161436eff9b900548c57f00b0a7ac0cda40368634e1b"} Jun 03 13:48:07.142044 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:07.141675 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 13:48:07.995516 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:07.995478 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:07.995670 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:07.995622 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:07.995931 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:07.995767 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:07.995931 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:07.995884 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:08.636275 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:08.636242 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:48:08.636998 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:08.636531 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 13:48:08.647520 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:08.647481 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" podUID="4b8ba6fb-bc6e-4cba-a402-7db8544da6fb" containerName="ovnkube-controller" probeResult="failure" output="" Jun 03 13:48:08.657517 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:08.657485 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" podUID="4b8ba6fb-bc6e-4cba-a402-7db8544da6fb" containerName="ovnkube-controller" probeResult="failure" output="" Jun 03 13:48:08.669857 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:08.669829 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:48:08.670001 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:08.669975 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 13:48:08.670631 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:08.670534 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xdfnh" Jun 03 13:48:09.994247 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:09.994197 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:09.994848 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:09.994204 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:09.994848 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:09.994343 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:09.994848 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:09.994454 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:11.734525 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:11.734485 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:11.734525 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:11.734531 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:11.735188 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.734653 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:48:11.735188 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.734743 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs podName:1f95aa13-89ff-4764-80e3-ba2701e0d364 nodeName:}" failed. No retries permitted until 2026-06-03 13:48:43.734719642 +0000 UTC m=+66.347124944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs") pod "network-metrics-daemon-tcn5x" (UID: "1f95aa13-89ff-4764-80e3-ba2701e0d364") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:48:11.735188 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.734665 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:48:11.735188 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.734798 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:48:11.735188 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.734811 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2ft7b for pod openshift-network-diagnostics/network-check-target-btzh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:48:11.735188 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.734863 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b podName:97bfe6a5-b893-4801-9178-bd09d95b7f36 nodeName:}" failed. No retries permitted until 2026-06-03 13:48:43.734851265 +0000 UTC m=+66.347256567 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ft7b" (UniqueName: "kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b") pod "network-check-target-btzh4" (UID: "97bfe6a5-b893-4801-9178-bd09d95b7f36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:48:11.994280 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:11.994181 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:11.994280 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:11.994240 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:11.994495 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.994327 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:11.994495 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:11.994462 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:13.994084 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:13.994049 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:13.994084 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:13.994079 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:13.994550 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:13.994173 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:13.994550 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:13.994304 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:14.157486 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:14.157279 2562 generic.go:358] "Generic (PLEG): container finished" podID="08e644be-d8f1-4da3-8547-4d189c45819f" containerID="7f601d4a55fed7ce807f9f680dc66e4f651061513d00fc0163fa81d643e37341" exitCode=0 Jun 03 13:48:14.157486 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:14.157355 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerDied","Data":"7f601d4a55fed7ce807f9f680dc66e4f651061513d00fc0163fa81d643e37341"} Jun 03 13:48:15.161547 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:15.161513 2562 generic.go:358] "Generic (PLEG): container finished" podID="08e644be-d8f1-4da3-8547-4d189c45819f" containerID="1371528250c1c8643c121e2206340025bd5be8571bf0f5f949dab75b4dda48b6" exitCode=0 Jun 03 13:48:15.161929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:15.161552 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerDied","Data":"1371528250c1c8643c121e2206340025bd5be8571bf0f5f949dab75b4dda48b6"} Jun 03 13:48:15.994990 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:15.994954 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:15.995181 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:15.994955 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:15.995181 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:15.995108 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:15.995324 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:15.995176 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:16.166039 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:16.166000 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" event={"ID":"08e644be-d8f1-4da3-8547-4d189c45819f","Type":"ContainerStarted","Data":"bc77340664226c2c7cec4a33acae1b9adfa40b558fab9cf60601a1bfa0b3b03c"} Jun 03 13:48:16.195108 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:16.195055 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9vgdg" podStartSLOduration=5.57737043 podStartE2EDuration="38.195041545s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:47:40.609767712 +0000 UTC m=+3.222173008" lastFinishedPulling="2026-06-03 13:48:13.227438824 +0000 UTC m=+35.839844123" observedRunningTime="2026-06-03 13:48:16.194744161 +0000 UTC m=+38.807149477" watchObservedRunningTime="2026-06-03 13:48:16.195041545 +0000 UTC m=+38.807446878" Jun 03 13:48:17.994944 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:17.994913 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:17.995373 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:17.994999 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:17.995373 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:17.995037 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:17.995373 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:17.995089 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:19.994337 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:19.994307 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:19.994740 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:19.994399 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:19.994740 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:19.994480 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:19.994740 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:19.994569 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:21.994442 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:21.994401 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:21.994907 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:21.994532 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:21.994907 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:21.994580 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:21.994907 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:21.994669 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:23.994917 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:23.994878 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:23.995424 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:23.994984 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:23.995424 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:23.995039 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:23.995424 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:23.995134 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:25.994521 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:25.994488 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:25.995009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:25.994534 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:25.995009 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:25.994614 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:25.995009 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:25.994746 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:27.995602 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:27.995576 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:27.996082 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:27.995671 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btzh4" podUID="97bfe6a5-b893-4801-9178-bd09d95b7f36" Jun 03 13:48:27.996082 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:27.995755 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:27.996082 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:27.995863 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcn5x" podUID="1f95aa13-89ff-4764-80e3-ba2701e0d364" Jun 03 13:48:29.211514 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.211485 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeReady" Jun 03 13:48:29.211912 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.211614 2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 13:48:29.302539 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.302501 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jtx25"] Jun 03 13:48:29.337082 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.337048 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2dgd9"] Jun 03 13:48:29.337267 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.337199 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.340291 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.340259 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 13:48:29.340468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.340355 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 13:48:29.340547 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.340510 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4dx2f\"" Jun 03 13:48:29.350692 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.350670 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dgd9"] Jun 03 13:48:29.350692 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.350696 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtx25"] Jun 03 13:48:29.350861 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.350710 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nj58t"] Jun 03 13:48:29.350861 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.350817 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.353404 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.353360 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 13:48:29.353762 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.353741 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 13:48:29.353860 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.353741 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-68pcr\"" Jun 03 13:48:29.353860 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.353787 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 13:48:29.364901 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.364875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8210414-9d84-4e6d-86f9-bc8f6499ea52-config-volume\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.365025 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.364904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8210414-9d84-4e6d-86f9-bc8f6499ea52-metrics-tls\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.365025 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.364954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8210414-9d84-4e6d-86f9-bc8f6499ea52-tmp-dir\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.365025 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.364997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a1b9f5-a619-4a89-9b53-b0fd590813f2-cert\") pod \"ingress-canary-2dgd9\" (UID: \"47a1b9f5-a619-4a89-9b53-b0fd590813f2\") " pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.365147 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.365026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbs9p\" (UniqueName: \"kubernetes.io/projected/47a1b9f5-a619-4a89-9b53-b0fd590813f2-kube-api-access-mbs9p\") pod \"ingress-canary-2dgd9\" (UID: \"47a1b9f5-a619-4a89-9b53-b0fd590813f2\") " pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.365147 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.365046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrmb\" (UniqueName: \"kubernetes.io/projected/d8210414-9d84-4e6d-86f9-bc8f6499ea52-kube-api-access-vfrmb\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.366717 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.366701 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj58t"] Jun 03 13:48:29.366818 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.366807 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.370980 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.370960 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 13:48:29.371112 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.371097 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 13:48:29.371616 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.371599 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 13:48:29.371736 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.371656 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kpj7b\"" Jun 03 13:48:29.371736 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.371672 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 13:48:29.465584 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465546 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8210414-9d84-4e6d-86f9-bc8f6499ea52-tmp-dir\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.465584 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465585 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a1b9f5-a619-4a89-9b53-b0fd590813f2-cert\") pod \"ingress-canary-2dgd9\" (UID: \"47a1b9f5-a619-4a89-9b53-b0fd590813f2\") " pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.465810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465610 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbs9p\" (UniqueName: \"kubernetes.io/projected/47a1b9f5-a619-4a89-9b53-b0fd590813f2-kube-api-access-mbs9p\") pod \"ingress-canary-2dgd9\" (UID: \"47a1b9f5-a619-4a89-9b53-b0fd590813f2\") " pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.465810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465627 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrmb\" (UniqueName: \"kubernetes.io/projected/d8210414-9d84-4e6d-86f9-bc8f6499ea52-kube-api-access-vfrmb\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.465810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465669 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8210414-9d84-4e6d-86f9-bc8f6499ea52-config-volume\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.465810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-crio-socket\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.465810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465710 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8210414-9d84-4e6d-86f9-bc8f6499ea52-metrics-tls\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.466061 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.465976 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8210414-9d84-4e6d-86f9-bc8f6499ea52-tmp-dir\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.466337 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.466318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8210414-9d84-4e6d-86f9-bc8f6499ea52-config-volume\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.469475 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.469453 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8210414-9d84-4e6d-86f9-bc8f6499ea52-metrics-tls\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.469569 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.469500 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a1b9f5-a619-4a89-9b53-b0fd590813f2-cert\") pod \"ingress-canary-2dgd9\" (UID: \"47a1b9f5-a619-4a89-9b53-b0fd590813f2\") " pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.482363 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.482340 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbs9p\" (UniqueName: \"kubernetes.io/projected/47a1b9f5-a619-4a89-9b53-b0fd590813f2-kube-api-access-mbs9p\") pod \"ingress-canary-2dgd9\" (UID: \"47a1b9f5-a619-4a89-9b53-b0fd590813f2\") " pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.497133 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.497102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrmb\" (UniqueName: \"kubernetes.io/projected/d8210414-9d84-4e6d-86f9-bc8f6499ea52-kube-api-access-vfrmb\") pod \"dns-default-jtx25\" (UID: \"d8210414-9d84-4e6d-86f9-bc8f6499ea52\") " pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.566094 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.566055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-data-volume\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.566094 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.566093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9c68\" (UniqueName: \"kubernetes.io/projected/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-kube-api-access-m9c68\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.566383 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.566121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.566383 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.566203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.566383 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.566274 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-crio-socket\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.566508 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.566456 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-crio-socket\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.646910 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.646867 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:29.658638 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.658610 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dgd9" Jun 03 13:48:29.667259 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.667202 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-data-volume\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.667407 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.667272 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c68\" (UniqueName: \"kubernetes.io/projected/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-kube-api-access-m9c68\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.667407 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.667322 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.667407 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.667366 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.667610 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.667592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-data-volume\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.668030 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.667969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.670598 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.670467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.684850 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.684788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9c68\" (UniqueName: \"kubernetes.io/projected/d6f5d5c4-45eb-48fa-962a-c873f5f7bd51-kube-api-access-m9c68\") pod \"insights-runtime-extractor-nj58t\" (UID: \"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51\") " pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.768157 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.768118 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr"] Jun 03 13:48:29.788820 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.787971 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr"] Jun 03 13:48:29.788820 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.788121 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" Jun 03 13:48:29.806291 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.802380 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 13:48:29.806517 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.806490 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4bng6\"" Jun 03 13:48:29.870174 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.870153 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtx25"] Jun 03 13:48:29.871828 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:29.871798 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8210414_9d84_4e6d_86f9_bc8f6499ea52.slice/crio-51e6336590ce9fab2b74c698e1709ef66091bf586220ea13592cacee23da2eb4 WatchSource:0}: Error finding container 51e6336590ce9fab2b74c698e1709ef66091bf586220ea13592cacee23da2eb4: Status 404 returned error can't find the container with id 51e6336590ce9fab2b74c698e1709ef66091bf586220ea13592cacee23da2eb4 Jun 03 13:48:29.901376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.901339 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dgd9"] Jun 03 13:48:29.904624 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:29.904600 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a1b9f5_a619_4a89_9b53_b0fd590813f2.slice/crio-6655a4e6f7826f21ec942a393ca3532d590c632711b04be67cb6c39f995f1793 WatchSource:0}: Error finding container 6655a4e6f7826f21ec942a393ca3532d590c632711b04be67cb6c39f995f1793: Status 404 returned error can't find the container with id 6655a4e6f7826f21ec942a393ca3532d590c632711b04be67cb6c39f995f1793 Jun 03 13:48:29.969326 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.969284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/72493099-ac7f-4b1e-a0f9-b4ef2d901fdb-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-sbfmr\" (UID: \"72493099-ac7f-4b1e-a0f9-b4ef2d901fdb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" Jun 03 13:48:29.975414 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.975386 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj58t" Jun 03 13:48:29.994245 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.994165 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:29.994372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.994346 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:29.998047 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.998022 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 13:48:29.998263 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.998212 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hmwfp\"" Jun 03 13:48:29.998353 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.998267 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 13:48:29.998353 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.998323 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 13:48:29.999024 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:29.999003 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5xc9\"" Jun 03 13:48:30.069682 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.069651 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/72493099-ac7f-4b1e-a0f9-b4ef2d901fdb-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-sbfmr\" (UID: \"72493099-ac7f-4b1e-a0f9-b4ef2d901fdb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" Jun 03 13:48:30.071977 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.071952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/72493099-ac7f-4b1e-a0f9-b4ef2d901fdb-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-sbfmr\" (UID: \"72493099-ac7f-4b1e-a0f9-b4ef2d901fdb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" Jun 03 13:48:30.107614 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.107583 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj58t"] Jun 03 13:48:30.111937 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.111918 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" Jun 03 13:48:30.112214 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:30.112191 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f5d5c4_45eb_48fa_962a_c873f5f7bd51.slice/crio-5e177702f5cbd2a15dd6659d05046acc738a75b7d571b092fe92cbf408ca6119 WatchSource:0}: Error finding container 5e177702f5cbd2a15dd6659d05046acc738a75b7d571b092fe92cbf408ca6119: Status 404 returned error can't find the container with id 5e177702f5cbd2a15dd6659d05046acc738a75b7d571b092fe92cbf408ca6119 Jun 03 13:48:30.193527 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.193496 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtx25" event={"ID":"d8210414-9d84-4e6d-86f9-bc8f6499ea52","Type":"ContainerStarted","Data":"51e6336590ce9fab2b74c698e1709ef66091bf586220ea13592cacee23da2eb4"} Jun 03 13:48:30.194851 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.194825 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj58t" event={"ID":"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51","Type":"ContainerStarted","Data":"2071a5b2da3176f6837bd7e3e5aced206e5cba446b20e0f1662c75918511403c"} Jun 03 13:48:30.195015 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.194855 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj58t" event={"ID":"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51","Type":"ContainerStarted","Data":"5e177702f5cbd2a15dd6659d05046acc738a75b7d571b092fe92cbf408ca6119"} Jun 03 13:48:30.198140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.198099 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dgd9" event={"ID":"47a1b9f5-a619-4a89-9b53-b0fd590813f2","Type":"ContainerStarted","Data":"6655a4e6f7826f21ec942a393ca3532d590c632711b04be67cb6c39f995f1793"} Jun 03 13:48:30.245392 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:30.245316 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr"] Jun 03 13:48:30.249420 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:30.249393 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72493099_ac7f_4b1e_a0f9_b4ef2d901fdb.slice/crio-10ac831acbee5728beb7091ac8f860de48f0ae24b124a9cfefb917b30fd5fbb7 WatchSource:0}: Error finding container 10ac831acbee5728beb7091ac8f860de48f0ae24b124a9cfefb917b30fd5fbb7: Status 404 returned error can't find the container with id 10ac831acbee5728beb7091ac8f860de48f0ae24b124a9cfefb917b30fd5fbb7 Jun 03 13:48:31.202911 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:31.202872 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj58t" event={"ID":"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51","Type":"ContainerStarted","Data":"7b183decce2e8a32a0f8dee1b44d48a3572da1aa83dabfa9d57c5505f3b10364"} Jun 03 13:48:31.204373 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:31.204301 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" event={"ID":"72493099-ac7f-4b1e-a0f9-b4ef2d901fdb","Type":"ContainerStarted","Data":"10ac831acbee5728beb7091ac8f860de48f0ae24b124a9cfefb917b30fd5fbb7"} Jun 03 13:48:33.216121 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.216084 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" event={"ID":"72493099-ac7f-4b1e-a0f9-b4ef2d901fdb","Type":"ContainerStarted","Data":"b85c2d08270f4f3f1bd8b48d98a7767a9eb65d033c405667dba42fcd16a078d7"} Jun 03 13:48:33.216632 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.216286 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" Jun 03 13:48:33.217842 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.217786 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtx25" event={"ID":"d8210414-9d84-4e6d-86f9-bc8f6499ea52","Type":"ContainerStarted","Data":"022ffd3c846837d022e1905d026d655536473c14eb83fd8b8b01f7bd9e865615"} Jun 03 13:48:33.217842 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.217823 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtx25" event={"ID":"d8210414-9d84-4e6d-86f9-bc8f6499ea52","Type":"ContainerStarted","Data":"e401fc52d4c0ad6e0d1e813bf060c810d8c68ab2978d330decf6fc57ef38e99c"} Jun 03 13:48:33.218022 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.217858 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:33.219798 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.219777 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj58t" event={"ID":"d6f5d5c4-45eb-48fa-962a-c873f5f7bd51","Type":"ContainerStarted","Data":"0b808374e07cc218be5fd08d872181df85e62780c1ed8b143b6a32aee2a5fcd5"} Jun 03 13:48:33.221548 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.221527 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dgd9" event={"ID":"47a1b9f5-a619-4a89-9b53-b0fd590813f2","Type":"ContainerStarted","Data":"421bb25dfb6e6ff936e55c3d54668e7b56cb7c9129067e9c74cb85986233329f"} Jun 03 13:48:33.221864 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.221849 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" Jun 03 13:48:33.236985 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.236939 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-sbfmr" podStartSLOduration=2.35793513 podStartE2EDuration="4.236926439s" podCreationTimestamp="2026-06-03 13:48:29 +0000 UTC" firstStartedPulling="2026-06-03 13:48:30.251680178 +0000 UTC m=+52.864085476" lastFinishedPulling="2026-06-03 13:48:32.130671476 +0000 UTC m=+54.743076785" observedRunningTime="2026-06-03 13:48:33.236019486 +0000 UTC m=+55.848424803" watchObservedRunningTime="2026-06-03 13:48:33.236926439 +0000 UTC m=+55.849331748" Jun 03 13:48:33.265743 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.265692 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nj58t" podStartSLOduration=1.660527046 podStartE2EDuration="4.265676482s" podCreationTimestamp="2026-06-03 13:48:29 +0000 UTC" firstStartedPulling="2026-06-03 13:48:30.185761405 +0000 UTC m=+52.798166705" lastFinishedPulling="2026-06-03 13:48:32.790910837 +0000 UTC m=+55.403316141" observedRunningTime="2026-06-03 13:48:33.265262029 +0000 UTC m=+55.877667345" watchObservedRunningTime="2026-06-03 13:48:33.265676482 +0000 UTC m=+55.878081819" Jun 03 13:48:33.297831 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.297785 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2dgd9" podStartSLOduration=2.07460893 podStartE2EDuration="4.297771102s" podCreationTimestamp="2026-06-03 13:48:29 +0000 UTC" firstStartedPulling="2026-06-03 13:48:29.906395249 +0000 UTC m=+52.518800543" lastFinishedPulling="2026-06-03 13:48:32.129557408 +0000 UTC m=+54.741962715" observedRunningTime="2026-06-03 13:48:33.297334992 +0000 UTC m=+55.909740308" watchObservedRunningTime="2026-06-03 13:48:33.297771102 +0000 UTC m=+55.910176417" Jun 03 13:48:33.356593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.356538 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jtx25" podStartSLOduration=2.095077972 podStartE2EDuration="4.356523493s" podCreationTimestamp="2026-06-03 13:48:29 +0000 UTC" firstStartedPulling="2026-06-03 13:48:29.873660052 +0000 UTC m=+52.486065346" lastFinishedPulling="2026-06-03 13:48:32.135105574 +0000 UTC m=+54.747510867" observedRunningTime="2026-06-03 13:48:33.356145975 +0000 UTC m=+55.968551282" watchObservedRunningTime="2026-06-03 13:48:33.356523493 +0000 UTC m=+55.968928808" Jun 03 13:48:33.869145 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.869112 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj"] Jun 03 13:48:33.871156 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.871141 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.875812 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.875785 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 13:48:33.877957 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.877935 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 13:48:33.879083 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.879063 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6bs2r\"" Jun 03 13:48:33.879186 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.879090 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 13:48:33.879186 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.879162 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 13:48:33.879300 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.879238 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 13:48:33.887845 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.887821 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj"] Jun 03 13:48:33.896328 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.896305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.896466 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.896353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.896466 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.896383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f969aa61-179f-4dec-883a-78786dd5f7e9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.896466 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.896398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2f42\" (UniqueName: \"kubernetes.io/projected/f969aa61-179f-4dec-883a-78786dd5f7e9-kube-api-access-n2f42\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.996681 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.996645 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.996875 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.996689 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f969aa61-179f-4dec-883a-78786dd5f7e9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.996875 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.996717 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2f42\" (UniqueName: \"kubernetes.io/projected/f969aa61-179f-4dec-883a-78786dd5f7e9-kube-api-access-n2f42\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.996875 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.996777 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.996875 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:33.996869 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 13:48:33.997083 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:33.996934 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-tls podName:f969aa61-179f-4dec-883a-78786dd5f7e9 nodeName:}" failed. No retries permitted until 2026-06-03 13:48:34.496916283 +0000 UTC m=+57.109321596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-jl5hj" (UID: "f969aa61-179f-4dec-883a-78786dd5f7e9") : secret "prometheus-operator-tls" not found Jun 03 13:48:33.997471 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.997448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f969aa61-179f-4dec-883a-78786dd5f7e9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:33.999053 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:33.999032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:34.010765 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:34.010737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2f42\" (UniqueName: \"kubernetes.io/projected/f969aa61-179f-4dec-883a-78786dd5f7e9-kube-api-access-n2f42\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:34.502314 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:34.502274 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:34.504711 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:34.504685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f969aa61-179f-4dec-883a-78786dd5f7e9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jl5hj\" (UID: \"f969aa61-179f-4dec-883a-78786dd5f7e9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:34.779831 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:34.779733 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" Jun 03 13:48:34.907314 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:34.907284 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj"] Jun 03 13:48:34.911278 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:34.911252 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf969aa61_179f_4dec_883a_78786dd5f7e9.slice/crio-7a7c62b22b9d37c093b65497a74fdf4247cd8ec817fb81249c0be962ad159527 WatchSource:0}: Error finding container 7a7c62b22b9d37c093b65497a74fdf4247cd8ec817fb81249c0be962ad159527: Status 404 returned error can't find the container with id 7a7c62b22b9d37c093b65497a74fdf4247cd8ec817fb81249c0be962ad159527 Jun 03 13:48:35.228620 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.228585 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" event={"ID":"f969aa61-179f-4dec-883a-78786dd5f7e9","Type":"ContainerStarted","Data":"7a7c62b22b9d37c093b65497a74fdf4247cd8ec817fb81249c0be962ad159527"} Jun 03 13:48:35.286717 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.286684 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c87d8b88-v9w9d"] Jun 03 13:48:35.289303 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.289286 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.299979 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.299942 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m7n9b\"" Jun 03 13:48:35.300096 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.299996 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 13:48:35.300096 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.300035 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 13:48:35.300096 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.299997 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 13:48:35.300096 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.300058 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 13:48:35.300982 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.300966 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 13:48:35.301055 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.301042 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 13:48:35.301089 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.301045 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 13:48:35.306452 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.306430 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c87d8b88-v9w9d"] Jun 03 13:48:35.306632 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.306616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zkcw\" (UniqueName: \"kubernetes.io/projected/ffc9b149-38bf-45f0-a063-eca8a1379222-kube-api-access-2zkcw\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.306676 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.306645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-oauth-serving-cert\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.306751 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.306735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-serving-cert\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.306858 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.306838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-console-config\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.306894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.306875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-service-ca\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.306927 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.306909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-oauth-config\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.408211 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.408169 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-oauth-serving-cert\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.408415 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.408252 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-serving-cert\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.408415 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.408309 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-console-config\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.408415 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.408326 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-service-ca\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.408415 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.408355 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-oauth-config\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.408415 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.408374 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkcw\" (UniqueName: \"kubernetes.io/projected/ffc9b149-38bf-45f0-a063-eca8a1379222-kube-api-access-2zkcw\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.409041 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.409005 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-oauth-serving-cert\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.409164 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.409031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-service-ca\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.409164 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.409015 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-console-config\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.410705 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.410684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-serving-cert\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.410809 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.410711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-oauth-config\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.417936 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.417916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkcw\" (UniqueName: \"kubernetes.io/projected/ffc9b149-38bf-45f0-a063-eca8a1379222-kube-api-access-2zkcw\") pod \"console-74c87d8b88-v9w9d\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.598013 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.597938 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:35.739134 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:35.739098 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c87d8b88-v9w9d"] Jun 03 13:48:35.742579 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:35.742551 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc9b149_38bf_45f0_a063_eca8a1379222.slice/crio-fd942db23742e9e9b66efac741d4eb23886b5b634d71c81acb30b189d797ca14 WatchSource:0}: Error finding container fd942db23742e9e9b66efac741d4eb23886b5b634d71c81acb30b189d797ca14: Status 404 returned error can't find the container with id fd942db23742e9e9b66efac741d4eb23886b5b634d71c81acb30b189d797ca14 Jun 03 13:48:36.232304 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:36.232267 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c87d8b88-v9w9d" event={"ID":"ffc9b149-38bf-45f0-a063-eca8a1379222","Type":"ContainerStarted","Data":"fd942db23742e9e9b66efac741d4eb23886b5b634d71c81acb30b189d797ca14"} Jun 03 13:48:37.236426 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:37.236387 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" event={"ID":"f969aa61-179f-4dec-883a-78786dd5f7e9","Type":"ContainerStarted","Data":"34b02e32f594a87bfc3a67b69ad019ad6fc2fca73da71d96a56cd569b40b36d5"} Jun 03 13:48:37.236426 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:37.236433 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" event={"ID":"f969aa61-179f-4dec-883a-78786dd5f7e9","Type":"ContainerStarted","Data":"afb6ab134b114e1dfbe8d22469dfa2431c541eff76821b2ffb95f8f4e1ab4a4a"} Jun 03 13:48:37.264464 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:37.264360 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jl5hj" podStartSLOduration=2.602034265 podStartE2EDuration="4.264333191s" podCreationTimestamp="2026-06-03 13:48:33 +0000 UTC" firstStartedPulling="2026-06-03 13:48:34.913050879 +0000 UTC m=+57.525456177" lastFinishedPulling="2026-06-03 13:48:36.575349806 +0000 UTC m=+59.187755103" observedRunningTime="2026-06-03 13:48:37.263797525 +0000 UTC m=+59.876202842" watchObservedRunningTime="2026-06-03 13:48:37.264333191 +0000 UTC m=+59.876738508" Jun 03 13:48:38.659805 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:38.659772 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nngck" Jun 03 13:48:39.243506 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.243476 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c87d8b88-v9w9d" event={"ID":"ffc9b149-38bf-45f0-a063-eca8a1379222","Type":"ContainerStarted","Data":"2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc"} Jun 03 13:48:39.274250 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.274167 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74c87d8b88-v9w9d" podStartSLOduration=0.964436597 podStartE2EDuration="4.274150188s" podCreationTimestamp="2026-06-03 13:48:35 +0000 UTC" firstStartedPulling="2026-06-03 13:48:35.744817755 +0000 UTC m=+58.357223053" lastFinishedPulling="2026-06-03 13:48:39.054531334 +0000 UTC m=+61.666936644" observedRunningTime="2026-06-03 13:48:39.271990947 +0000 UTC m=+61.884396264" watchObservedRunningTime="2026-06-03 13:48:39.274150188 +0000 UTC m=+61.886555506" Jun 03 13:48:39.388124 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.388043 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-7z4mz"] Jun 03 13:48:39.390037 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.390020 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.392725 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.392700 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 13:48:39.392818 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.392703 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 13:48:39.398046 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.394419 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9pz2l\"" Jun 03 13:48:39.408713 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.408684 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-7z4mz"] Jun 03 13:48:39.440400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.440353 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc"] Jun 03 13:48:39.440636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.440613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8d5f0f-8233-4226-bcbb-8328dae39888-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.440693 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.440664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8d5f0f-8233-4226-bcbb-8328dae39888-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.440693 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.440685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d664g\" (UniqueName: \"kubernetes.io/projected/4a8d5f0f-8233-4226-bcbb-8328dae39888-kube-api-access-d664g\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.440811 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.440770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8d5f0f-8233-4226-bcbb-8328dae39888-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.442380 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.442367 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.445592 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.445567 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 13:48:39.445754 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.445684 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 13:48:39.445885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.445873 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vw9cz\"" Jun 03 13:48:39.446141 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.446126 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 13:48:39.477046 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.477014 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc"] Jun 03 13:48:39.499241 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.499201 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jxnnt"] Jun 03 13:48:39.501345 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.501323 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.509365 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.509340 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 13:48:39.509686 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.509669 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 13:48:39.509905 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.509892 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 13:48:39.515168 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.515149 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q77dj\"" Jun 03 13:48:39.541536 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541509 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8d5f0f-8233-4226-bcbb-8328dae39888-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.541685 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.541685 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-textfile\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.541685 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.541685 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-wtmp\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-sys\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541748 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8d5f0f-8233-4226-bcbb-8328dae39888-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hdk\" (UniqueName: \"kubernetes.io/projected/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-api-access-r9hdk\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541858 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8d5f0f-8233-4226-bcbb-8328dae39888-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj2s6\" (UniqueName: \"kubernetes.io/projected/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-kube-api-access-mj2s6\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541909 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d664g\" (UniqueName: \"kubernetes.io/projected/4a8d5f0f-8233-4226-bcbb-8328dae39888-kube-api-access-d664g\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.541950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.542439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.541965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-root\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.542439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.542010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-tls\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.542439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.542047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.542439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.542083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-metrics-client-ca\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.542439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.542349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8d5f0f-8233-4226-bcbb-8328dae39888-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.544143 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.544122 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8d5f0f-8233-4226-bcbb-8328dae39888-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.544245 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.544232 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a8d5f0f-8233-4226-bcbb-8328dae39888-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.558408 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.558388 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d664g\" (UniqueName: \"kubernetes.io/projected/4a8d5f0f-8233-4226-bcbb-8328dae39888-kube-api-access-d664g\") pod \"openshift-state-metrics-85658796db-7z4mz\" (UID: \"4a8d5f0f-8233-4226-bcbb-8328dae39888\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.642811 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642716 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.642811 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642756 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-textfile\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.642811 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642786 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642828 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642852 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-wtmp\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642889 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-sys\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642918 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hdk\" (UniqueName: \"kubernetes.io/projected/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-api-access-r9hdk\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642943 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642970 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.642971 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-sys\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643015 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mj2s6\" (UniqueName: \"kubernetes.io/projected/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-kube-api-access-mj2s6\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-wtmp\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643061 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643557 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643091 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-root\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643557 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643114 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-tls\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643557 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643142 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643557 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643166 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-metrics-client-ca\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643557 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-textfile\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643557 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643291 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-root\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.643841 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643841 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643841 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.643997 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.643978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.644321 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.644298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-metrics-client-ca\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.645535 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.645510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.645535 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.645526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-node-exporter-tls\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.645687 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.645671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.645832 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.645811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.658909 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.658880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hdk\" (UniqueName: \"kubernetes.io/projected/829b0fc4-75f8-48f6-b1d3-a75ee61122c8-kube-api-access-r9hdk\") pod \"kube-state-metrics-8469c486bb-mqzpc\" (UID: \"829b0fc4-75f8-48f6-b1d3-a75ee61122c8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.660718 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.660698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj2s6\" (UniqueName: \"kubernetes.io/projected/7d1aa2df-2056-4d16-b5b1-0a59162fdbe7-kube-api-access-mj2s6\") pod \"node-exporter-jxnnt\" (UID: \"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7\") " pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.700694 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.700656 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" Jun 03 13:48:39.750929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.750895 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" Jun 03 13:48:39.810836 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.810213 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxnnt" Jun 03 13:48:39.824277 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:39.824245 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1aa2df_2056_4d16_b5b1_0a59162fdbe7.slice/crio-13bb89518224419fe0a4479baf734b92cec79f425947ce3ff2d2153471c1ce3a WatchSource:0}: Error finding container 13bb89518224419fe0a4479baf734b92cec79f425947ce3ff2d2153471c1ce3a: Status 404 returned error can't find the container with id 13bb89518224419fe0a4479baf734b92cec79f425947ce3ff2d2153471c1ce3a Jun 03 13:48:39.855030 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.854993 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-7z4mz"] Jun 03 13:48:39.858261 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:39.858212 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8d5f0f_8233_4226_bcbb_8328dae39888.slice/crio-d8a390ec2c8bf86f506dc2598149d4aa820bc1abda1c144966b252dc043d38bc WatchSource:0}: Error finding container d8a390ec2c8bf86f506dc2598149d4aa820bc1abda1c144966b252dc043d38bc: Status 404 returned error can't find the container with id d8a390ec2c8bf86f506dc2598149d4aa820bc1abda1c144966b252dc043d38bc Jun 03 13:48:39.908023 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:39.907995 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc"] Jun 03 13:48:39.911902 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:39.911872 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829b0fc4_75f8_48f6_b1d3_a75ee61122c8.slice/crio-880448316d2bfafcab21baefb24e525a6036bfcc5843d558802d2f20be5ed86a WatchSource:0}: Error finding container 880448316d2bfafcab21baefb24e525a6036bfcc5843d558802d2f20be5ed86a: Status 404 returned error can't find the container with id 880448316d2bfafcab21baefb24e525a6036bfcc5843d558802d2f20be5ed86a Jun 03 13:48:40.247958 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.247920 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" event={"ID":"829b0fc4-75f8-48f6-b1d3-a75ee61122c8","Type":"ContainerStarted","Data":"880448316d2bfafcab21baefb24e525a6036bfcc5843d558802d2f20be5ed86a"} Jun 03 13:48:40.249622 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.249595 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" event={"ID":"4a8d5f0f-8233-4226-bcbb-8328dae39888","Type":"ContainerStarted","Data":"cbc2d8932a123bce6ad48f846c4e4c0eb36811af1dd97658cfd6160c9773aa95"} Jun 03 13:48:40.249768 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.249627 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" event={"ID":"4a8d5f0f-8233-4226-bcbb-8328dae39888","Type":"ContainerStarted","Data":"69192dc298a2f1fd010f9f8cc24279478b7971aa33f6ef1726af3909590d0578"} Jun 03 13:48:40.249768 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.249640 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" event={"ID":"4a8d5f0f-8233-4226-bcbb-8328dae39888","Type":"ContainerStarted","Data":"d8a390ec2c8bf86f506dc2598149d4aa820bc1abda1c144966b252dc043d38bc"} Jun 03 13:48:40.250887 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.250854 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxnnt" event={"ID":"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7","Type":"ContainerStarted","Data":"13bb89518224419fe0a4479baf734b92cec79f425947ce3ff2d2153471c1ce3a"} Jun 03 13:48:40.502112 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.502027 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:48:40.505785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.505755 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.515010 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.514318 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 13:48:40.515010 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.514648 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 13:48:40.515010 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.514976 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 13:48:40.515207 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.515064 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 13:48:40.515408 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.515390 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-92zlc\"" Jun 03 13:48:40.515569 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.515551 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 13:48:40.516061 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.515708 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 13:48:40.516061 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.515912 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 13:48:40.518303 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.518284 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 13:48:40.518422 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.518325 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 13:48:40.533424 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.533387 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:48:40.550808 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.550772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-web-config\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.550950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.550814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-config-volume\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.550950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.550841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-config-out\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.550950 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.550894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551085 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.550998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551085 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551085 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84vm\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-kube-api-access-g84vm\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551189 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551189 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551287 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551287 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551287 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.551410 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.551318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652170 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652130 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652377 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652266 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652377 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652294 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g84vm\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-kube-api-access-g84vm\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652377 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652327 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652377 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652359 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652390 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652417 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652443 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652483 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652529 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-web-config\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:40.652562 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle podName:57f5ad2f-059b-4f10-bc93-1d463361acde nodeName:}" failed. No retries permitted until 2026-06-03 13:48:41.15254002 +0000 UTC m=+63.764945335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde") : configmap references non-existent config key: ca-bundle.crt Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652600 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-config-volume\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.652645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652630 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-config-out\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.653028 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.652654 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.653028 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:40.652799 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 13:48:40.653028 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:48:40.652852 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls podName:57f5ad2f-059b-4f10-bc93-1d463361acde nodeName:}" failed. No retries permitted until 2026-06-03 13:48:41.152837016 +0000 UTC m=+63.765242318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde") : secret "alertmanager-main-tls" not found Jun 03 13:48:40.654186 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.653866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.655386 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.654891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.657478 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.657425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.657680 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.657657 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-config-out\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.658102 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.657885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-web-config\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.658102 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.658066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-config-volume\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.658246 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.658165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.658671 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.658612 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.659378 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.659342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.659952 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.659921 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:40.670255 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:40.670181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84vm\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-kube-api-access-g84vm\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:41.158610 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.158556 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:41.158790 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.158759 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:41.159633 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.159597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:41.161201 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.161176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:41.257146 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.257105 2562 generic.go:358] "Generic (PLEG): container finished" podID="7d1aa2df-2056-4d16-b5b1-0a59162fdbe7" containerID="4c115b2d9583060e219551e59a9d79d38e834ae6912f75cfcf63872563d3815f" exitCode=0 Jun 03 13:48:41.257350 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.257172 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxnnt" event={"ID":"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7","Type":"ContainerDied","Data":"4c115b2d9583060e219551e59a9d79d38e834ae6912f75cfcf63872563d3815f"} Jun 03 13:48:41.375240 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.375191 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-96546579b-n89t2"] Jun 03 13:48:41.378543 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.378481 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.381177 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.381150 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 13:48:41.381988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.381969 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 13:48:41.382360 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.382339 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 13:48:41.382689 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.382511 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 13:48:41.382689 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.382511 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3eird7h10ndkr\"" Jun 03 13:48:41.382689 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.382558 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 13:48:41.382886 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.382866 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4hg6c\"" Jun 03 13:48:41.392467 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.392446 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96546579b-n89t2"] Jun 03 13:48:41.417451 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.417417 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:48:41.460746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.460720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.460845 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.460761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pctg\" (UniqueName: \"kubernetes.io/projected/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-kube-api-access-5pctg\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.460845 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.460791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-metrics-client-ca\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.460845 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.460822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-grpc-tls\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.461000 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.460904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.461000 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.460992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.461125 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.461097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.461253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.461212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-tls\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.562679 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.562558 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.562679 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.562641 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.563026 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.562946 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.563247 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.563005 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-tls\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.563407 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.563359 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.563568 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.563497 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pctg\" (UniqueName: \"kubernetes.io/projected/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-kube-api-access-5pctg\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.563568 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.563539 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-metrics-client-ca\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.563785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.563732 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-grpc-tls\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.566084 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.566020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-metrics-client-ca\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.572114 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.571872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.572684 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.572639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.573190 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.573141 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-tls\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.573870 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.573821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.574158 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.574102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.576199 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.576155 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pctg\" (UniqueName: \"kubernetes.io/projected/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-kube-api-access-5pctg\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.576349 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.576290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eddcbf42-ab96-4bbc-81b0-a9c5e50b691b-secret-grpc-tls\") pod \"thanos-querier-96546579b-n89t2\" (UID: \"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b\") " pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.655853 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.655823 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:48:41.662308 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:41.662282 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f5ad2f_059b_4f10_bc93_1d463361acde.slice/crio-8eb161ddd17b09c3e7b948d17e2b363a26804bf4326a6902f4305faaaef676ab WatchSource:0}: Error finding container 8eb161ddd17b09c3e7b948d17e2b363a26804bf4326a6902f4305faaaef676ab: Status 404 returned error can't find the container with id 8eb161ddd17b09c3e7b948d17e2b363a26804bf4326a6902f4305faaaef676ab Jun 03 13:48:41.689041 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.689014 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:41.842012 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:41.841692 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96546579b-n89t2"] Jun 03 13:48:41.844098 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:41.844072 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddcbf42_ab96_4bbc_81b0_a9c5e50b691b.slice/crio-4b550d2e6769e762690394c962659b8d0410c256f14b1562c7d6cfea2921caa1 WatchSource:0}: Error finding container 4b550d2e6769e762690394c962659b8d0410c256f14b1562c7d6cfea2921caa1: Status 404 returned error can't find the container with id 4b550d2e6769e762690394c962659b8d0410c256f14b1562c7d6cfea2921caa1 Jun 03 13:48:42.261164 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.261127 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" event={"ID":"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b","Type":"ContainerStarted","Data":"4b550d2e6769e762690394c962659b8d0410c256f14b1562c7d6cfea2921caa1"} Jun 03 13:48:42.262182 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.262150 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerStarted","Data":"8eb161ddd17b09c3e7b948d17e2b363a26804bf4326a6902f4305faaaef676ab"} Jun 03 13:48:42.263918 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.263895 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" event={"ID":"829b0fc4-75f8-48f6-b1d3-a75ee61122c8","Type":"ContainerStarted","Data":"60abf82bcdcdf8409b48aa6999b6e9f8ebc8d1cc376c736182435d8a20d4f6f3"} Jun 03 13:48:42.264009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.263924 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" event={"ID":"829b0fc4-75f8-48f6-b1d3-a75ee61122c8","Type":"ContainerStarted","Data":"51e3cf89660d86ff59cc2a5c1e38b17c1e1c40f541c275be13560139bce1d999"} Jun 03 13:48:42.264009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.263939 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" event={"ID":"829b0fc4-75f8-48f6-b1d3-a75ee61122c8","Type":"ContainerStarted","Data":"fd5c820829f01405a0bfb72c297ddb8bcc967b996967b3e3deb979497fce24d3"} Jun 03 13:48:42.265523 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.265503 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" event={"ID":"4a8d5f0f-8233-4226-bcbb-8328dae39888","Type":"ContainerStarted","Data":"e4f436647032d15ba3b1f64e4262310e0134a84359c83ac707db821a162d4b49"} Jun 03 13:48:42.267119 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.267101 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxnnt" event={"ID":"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7","Type":"ContainerStarted","Data":"b4b668d7ead9e681649e2d8c718bab516da9c5192020e794d36baa19aa4e4811"} Jun 03 13:48:42.267179 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.267123 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxnnt" event={"ID":"7d1aa2df-2056-4d16-b5b1-0a59162fdbe7","Type":"ContainerStarted","Data":"c4a27a60743619926442053f1aeb39fa777fb91202f24ee90dd759d2b9c6ffc8"} Jun 03 13:48:42.289704 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.289658 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mqzpc" podStartSLOduration=1.741982523 podStartE2EDuration="3.289645268s" podCreationTimestamp="2026-06-03 13:48:39 +0000 UTC" firstStartedPulling="2026-06-03 13:48:39.913859588 +0000 UTC m=+62.526264885" lastFinishedPulling="2026-06-03 13:48:41.46152232 +0000 UTC m=+64.073927630" observedRunningTime="2026-06-03 13:48:42.288870565 +0000 UTC m=+64.901275881" watchObservedRunningTime="2026-06-03 13:48:42.289645268 +0000 UTC m=+64.902050583" Jun 03 13:48:42.318261 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.318200 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jxnnt" podStartSLOduration=2.420660713 podStartE2EDuration="3.318185401s" podCreationTimestamp="2026-06-03 13:48:39 +0000 UTC" firstStartedPulling="2026-06-03 13:48:39.826105709 +0000 UTC m=+62.438511002" lastFinishedPulling="2026-06-03 13:48:40.723630384 +0000 UTC m=+63.336035690" observedRunningTime="2026-06-03 13:48:42.317426106 +0000 UTC m=+64.929831424" watchObservedRunningTime="2026-06-03 13:48:42.318185401 +0000 UTC m=+64.930590717" Jun 03 13:48:42.343280 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:42.343209 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-7z4mz" podStartSLOduration=1.845623678 podStartE2EDuration="3.343189571s" podCreationTimestamp="2026-06-03 13:48:39 +0000 UTC" firstStartedPulling="2026-06-03 13:48:39.960414038 +0000 UTC m=+62.572819336" lastFinishedPulling="2026-06-03 13:48:41.457979928 +0000 UTC m=+64.070385229" observedRunningTime="2026-06-03 13:48:42.342517497 +0000 UTC m=+64.954922814" watchObservedRunningTime="2026-06-03 13:48:42.343189571 +0000 UTC m=+64.955594886" Jun 03 13:48:43.227755 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.227729 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jtx25" Jun 03 13:48:43.782278 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.782214 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:43.782469 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.782293 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:43.785721 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.785690 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 13:48:43.786727 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.786700 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 13:48:43.796295 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.796266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f95aa13-89ff-4764-80e3-ba2701e0d364-metrics-certs\") pod \"network-metrics-daemon-tcn5x\" (UID: \"1f95aa13-89ff-4764-80e3-ba2701e0d364\") " pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:43.797199 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.797179 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 13:48:43.806492 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.806471 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ft7b\" (UniqueName: \"kubernetes.io/projected/97bfe6a5-b893-4801-9178-bd09d95b7f36-kube-api-access-2ft7b\") pod \"network-check-target-btzh4\" (UID: \"97bfe6a5-b893-4801-9178-bd09d95b7f36\") " pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:43.807009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.806992 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5xc9\"" Jun 03 13:48:43.813773 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.813751 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hmwfp\"" Jun 03 13:48:43.814794 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.814780 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcn5x" Jun 03 13:48:43.820437 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:43.820422 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:44.018618 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.018535 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8f678b84d-j4qb2"] Jun 03 13:48:44.036422 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.036352 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.054988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.054961 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7skko0dnlhg98\"" Jun 03 13:48:44.055252 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.055236 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 13:48:44.055536 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.055514 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 13:48:44.055642 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.055539 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-64d8n\"" Jun 03 13:48:44.055815 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.055800 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 13:48:44.061910 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.061888 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8f678b84d-j4qb2"] Jun 03 13:48:44.067356 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.067334 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 13:48:44.068665 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.068644 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcn5x"] Jun 03 13:48:44.083654 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.083630 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-btzh4"] Jun 03 13:48:44.085401 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.085384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-secret-metrics-server-client-certs\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.085482 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.085421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-secret-metrics-server-tls\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.085482 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.085447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-metrics-server-audit-profiles\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.085482 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.085470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.085592 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.085537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-client-ca-bundle\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.085592 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.085571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-audit-log\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.085657 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.085601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz85f\" (UniqueName: \"kubernetes.io/projected/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-kube-api-access-zz85f\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.119447 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:44.119420 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f95aa13_89ff_4764_80e3_ba2701e0d364.slice/crio-3d5d20a4a89371a68d25acb1d4f07f193c711bcffd4d4cb891081df713fb873b WatchSource:0}: Error finding container 3d5d20a4a89371a68d25acb1d4f07f193c711bcffd4d4cb891081df713fb873b: Status 404 returned error can't find the container with id 3d5d20a4a89371a68d25acb1d4f07f193c711bcffd4d4cb891081df713fb873b Jun 03 13:48:44.120238 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:44.120197 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bfe6a5_b893_4801_9178_bd09d95b7f36.slice/crio-fa6ac616f570c4ed2d7d258b1ee6fcd928111ecd46e071c487bf700784f336f2 WatchSource:0}: Error finding container fa6ac616f570c4ed2d7d258b1ee6fcd928111ecd46e071c487bf700784f336f2: Status 404 returned error can't find the container with id fa6ac616f570c4ed2d7d258b1ee6fcd928111ecd46e071c487bf700784f336f2 Jun 03 13:48:44.155637 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.155614 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c"] Jun 03 13:48:44.166707 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.166688 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" Jun 03 13:48:44.172487 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.172462 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-6ckhp\"" Jun 03 13:48:44.173049 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.172959 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 13:48:44.186521 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.186477 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-metrics-server-audit-profiles\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.186686 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.186535 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.186757 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.186662 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-client-ca-bundle\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.186824 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.186770 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-audit-log\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.186877 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.186823 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zz85f\" (UniqueName: \"kubernetes.io/projected/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-kube-api-access-zz85f\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.186932 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.186914 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-secret-metrics-server-client-certs\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.186986 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.186969 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-secret-metrics-server-tls\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.187553 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.187279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.187667 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.187586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-audit-log\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.187725 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.187660 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-metrics-server-audit-profiles\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.187924 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.187903 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c"] Jun 03 13:48:44.190011 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.189990 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-client-ca-bundle\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.190011 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.190002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-secret-metrics-server-tls\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.190155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.190086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-secret-metrics-server-client-certs\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.210561 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.210531 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz85f\" (UniqueName: \"kubernetes.io/projected/2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a-kube-api-access-zz85f\") pod \"metrics-server-8f678b84d-j4qb2\" (UID: \"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a\") " pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.274150 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.274121 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-btzh4" event={"ID":"97bfe6a5-b893-4801-9178-bd09d95b7f36","Type":"ContainerStarted","Data":"fa6ac616f570c4ed2d7d258b1ee6fcd928111ecd46e071c487bf700784f336f2"} Jun 03 13:48:44.275731 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.275699 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" event={"ID":"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b","Type":"ContainerStarted","Data":"82498c3334732cd8267255e443af16d59ffaa7dbc67c970f104964bb6d12a027"} Jun 03 13:48:44.277105 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.277076 2562 generic.go:358] "Generic (PLEG): container finished" podID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerID="4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28" exitCode=0 Jun 03 13:48:44.277252 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.277151 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28"} Jun 03 13:48:44.278419 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.278400 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcn5x" event={"ID":"1f95aa13-89ff-4764-80e3-ba2701e0d364","Type":"ContainerStarted","Data":"3d5d20a4a89371a68d25acb1d4f07f193c711bcffd4d4cb891081df713fb873b"} Jun 03 13:48:44.287453 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.287398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb1aad32-2948-46a2-822f-5eaa940e717d-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-n5r6c\" (UID: \"fb1aad32-2948-46a2-822f-5eaa940e717d\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" Jun 03 13:48:44.382282 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.382256 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:48:44.388245 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.388205 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb1aad32-2948-46a2-822f-5eaa940e717d-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-n5r6c\" (UID: \"fb1aad32-2948-46a2-822f-5eaa940e717d\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" Jun 03 13:48:44.391325 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.391297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb1aad32-2948-46a2-822f-5eaa940e717d-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-n5r6c\" (UID: \"fb1aad32-2948-46a2-822f-5eaa940e717d\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" Jun 03 13:48:44.475919 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.475886 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" Jun 03 13:48:44.488511 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.488486 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-66b56fd745-9qzkk"] Jun 03 13:48:44.520910 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.520870 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b56fd745-9qzkk"] Jun 03 13:48:44.521050 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.521024 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.524919 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.524891 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8f678b84d-j4qb2"] Jun 03 13:48:44.553353 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.553322 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 13:48:44.591255 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.590902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-console-config\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.591255 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.591008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-service-ca\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.591255 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.591037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-trusted-ca-bundle\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.591255 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.591075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-oauth-serving-cert\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.591255 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.591098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rqq\" (UniqueName: \"kubernetes.io/projected/52405641-2d4d-4781-bc5f-06c553df68fb-kube-api-access-84rqq\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.591255 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.591205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-serving-cert\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.591712 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.591350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-oauth-config\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.650724 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.650609 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c"] Jun 03 13:48:44.655708 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:44.655627 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1aad32_2948_46a2_822f_5eaa940e717d.slice/crio-8ace8a7e9c1d148d8c70093e4d3c7c8493fecd7297319d6e26430571d43ea292 WatchSource:0}: Error finding container 8ace8a7e9c1d148d8c70093e4d3c7c8493fecd7297319d6e26430571d43ea292: Status 404 returned error can't find the container with id 8ace8a7e9c1d148d8c70093e4d3c7c8493fecd7297319d6e26430571d43ea292 Jun 03 13:48:44.692190 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.692107 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-oauth-serving-cert\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.692190 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.692148 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84rqq\" (UniqueName: \"kubernetes.io/projected/52405641-2d4d-4781-bc5f-06c553df68fb-kube-api-access-84rqq\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.692447 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.692211 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-serving-cert\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.692447 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.692270 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-oauth-config\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.692447 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.692320 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-console-config\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.692447 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.692380 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-service-ca\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.692984 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.692851 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-trusted-ca-bundle\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.693162 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.693140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-service-ca\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.693250 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.693183 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-console-config\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.693839 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.693764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-trusted-ca-bundle\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.694119 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.694064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-oauth-serving-cert\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.696534 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.696512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-serving-cert\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.696636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.696559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-oauth-config\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.711995 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.711968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rqq\" (UniqueName: \"kubernetes.io/projected/52405641-2d4d-4781-bc5f-06c553df68fb-kube-api-access-84rqq\") pod \"console-66b56fd745-9qzkk\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:44.838376 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:44.838264 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:45.023690 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.023636 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b56fd745-9qzkk"] Jun 03 13:48:45.027050 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:48:45.027006 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52405641_2d4d_4781_bc5f_06c553df68fb.slice/crio-d83b481db841f4737d6d96b891e8cc3a10000c1a5593a281b2060936adea9275 WatchSource:0}: Error finding container d83b481db841f4737d6d96b891e8cc3a10000c1a5593a281b2060936adea9275: Status 404 returned error can't find the container with id d83b481db841f4737d6d96b891e8cc3a10000c1a5593a281b2060936adea9275 Jun 03 13:48:45.288174 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.288101 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" event={"ID":"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b","Type":"ContainerStarted","Data":"185814d8c5e05f5d099bb18f2d4cf6f8f97a66ca79053a493462c3fe8f1246a5"} Jun 03 13:48:45.288174 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.288149 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" event={"ID":"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b","Type":"ContainerStarted","Data":"3afa9d5be8be194d034e19608084523ae996f72096e815acfe1fa8e5640fa689"} Jun 03 13:48:45.289883 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.289833 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56fd745-9qzkk" event={"ID":"52405641-2d4d-4781-bc5f-06c553df68fb","Type":"ContainerStarted","Data":"d83b481db841f4737d6d96b891e8cc3a10000c1a5593a281b2060936adea9275"} Jun 03 13:48:45.291099 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.291053 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" event={"ID":"fb1aad32-2948-46a2-822f-5eaa940e717d","Type":"ContainerStarted","Data":"8ace8a7e9c1d148d8c70093e4d3c7c8493fecd7297319d6e26430571d43ea292"} Jun 03 13:48:45.292798 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.292768 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" event={"ID":"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a","Type":"ContainerStarted","Data":"2410605ad3c8c9e1530307dcc905f5a741ce7a79d780456cc8ecb3aaa12abc76"} Jun 03 13:48:45.598412 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.598323 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:45.598666 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.598630 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:45.606416 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.606171 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:45.864494 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.862999 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:48:45.875963 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.875935 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.883148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.883118 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 13:48:45.883447 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.883429 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 13:48:45.883543 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.883445 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 13:48:45.885338 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.884926 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 13:48:45.885338 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.885163 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 13:48:45.886666 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.886618 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 13:48:45.893000 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.892822 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rjh89\"" Jun 03 13:48:45.897434 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.897413 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c72orgbv9p8mg\"" Jun 03 13:48:45.897547 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.897445 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 13:48:45.907427 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907427 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907427 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907427 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907427 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907427 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.907785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.908163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.908163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.908163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.908163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.907900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5xxc\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-kube-api-access-n5xxc\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:45.909968 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.909942 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 13:48:45.910191 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.910173 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 13:48:45.910475 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.910457 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 13:48:45.910580 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.910457 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 13:48:45.932517 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.932484 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 13:48:45.935423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:45.935394 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:48:46.009414 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009373 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009598 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009422 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009598 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009455 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009598 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009501 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009598 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009529 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009598 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009557 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009610 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xxc\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-kube-api-access-n5xxc\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009650 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009689 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009741 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009783 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009803 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009821 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.009885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.010278 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009842 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.010278 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.009969 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.010278 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.010012 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.010278 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.010063 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.010278 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.010095 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.010520 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.010453 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.010614 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.010592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.013916 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.013891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.014090 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.014063 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.014746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.014272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.014746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.014308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.014746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.014512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.014746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.014700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.015009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.014878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.015607 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.015537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.015607 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.015550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.015755 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.015724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.016005 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.015967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.016806 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.016773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.018184 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.018161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.018400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.018382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.021797 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.021776 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5xxc\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-kube-api-access-n5xxc\") pod \"prometheus-k8s-0\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.189253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.189181 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:48:46.302836 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:46.302592 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:48:48.420412 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:48.420378 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:48:49.309612 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.309572 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcn5x" event={"ID":"1f95aa13-89ff-4764-80e3-ba2701e0d364","Type":"ContainerStarted","Data":"a4427713836f52f320604f3fabf757fc0ff36907de0fcf01976df770308aa6a9"} Jun 03 13:48:49.309612 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.309616 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcn5x" event={"ID":"1f95aa13-89ff-4764-80e3-ba2701e0d364","Type":"ContainerStarted","Data":"7a49f5bb270ce25ce8a2ad881255398f30bd12b7ee7147d5ba6b0a17eb9838b7"} Jun 03 13:48:49.310971 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.310945 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56fd745-9qzkk" event={"ID":"52405641-2d4d-4781-bc5f-06c553df68fb","Type":"ContainerStarted","Data":"beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4"} Jun 03 13:48:49.312181 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.312160 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" event={"ID":"fb1aad32-2948-46a2-822f-5eaa940e717d","Type":"ContainerStarted","Data":"2b5857730f32613b0ae5db6fb4f20a8aa813d73909c7df4e0a279ffb17b791cb"} Jun 03 13:48:49.312356 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.312330 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" Jun 03 13:48:49.313521 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.313500 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" event={"ID":"2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a","Type":"ContainerStarted","Data":"4a2b58e92201d382cac3b2d4f3137912fc92cbb0720c2e8980b55c26f6befa3d"} Jun 03 13:48:49.314826 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.314802 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-btzh4" event={"ID":"97bfe6a5-b893-4801-9178-bd09d95b7f36","Type":"ContainerStarted","Data":"0c3ea87133a5a8ddab02acb87700a145644251f016e8603574f55c7c939d4245"} Jun 03 13:48:49.314920 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.314910 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:48:49.316159 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.316139 2562 generic.go:358] "Generic (PLEG): container finished" podID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" exitCode=0 Jun 03 13:48:49.316268 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.316209 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f"} Jun 03 13:48:49.316268 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.316251 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerStarted","Data":"9a6735e4f015fc7f18ef434c698daa71ff97bedacacbd81e6bad946e62dbc678"} Jun 03 13:48:49.318596 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.318581 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" Jun 03 13:48:49.319057 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.319040 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" event={"ID":"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b","Type":"ContainerStarted","Data":"5590c1edff030f900c9e851d62d1975f89a21c327eabbbc4dbc49494a8bc3d25"} Jun 03 13:48:49.319057 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.319066 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" event={"ID":"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b","Type":"ContainerStarted","Data":"f68fac5ab4529b98bfccb7c1dedb11a7e50abedabc846b7937b43f4e1fdb2cf8"} Jun 03 13:48:49.319187 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.319081 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" event={"ID":"eddcbf42-ab96-4bbc-81b0-a9c5e50b691b","Type":"ContainerStarted","Data":"f931ce4fd444c558292f8dada8c1a9d4c72857ef0b99f9750b47dbe0a51d91c1"} Jun 03 13:48:49.319334 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.319250 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:49.322080 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.322061 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerStarted","Data":"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f"} Jun 03 13:48:49.322166 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.322086 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerStarted","Data":"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835"} Jun 03 13:48:49.322166 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.322101 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerStarted","Data":"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc"} Jun 03 13:48:49.322166 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.322114 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerStarted","Data":"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6"} Jun 03 13:48:49.322166 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.322127 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerStarted","Data":"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252"} Jun 03 13:48:49.322166 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.322139 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerStarted","Data":"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668"} Jun 03 13:48:49.324966 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.324950 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" Jun 03 13:48:49.328696 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.328659 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tcn5x" podStartSLOduration=67.2291843 podStartE2EDuration="1m11.328646615s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:48:44.136359561 +0000 UTC m=+66.748764863" lastFinishedPulling="2026-06-03 13:48:48.235821879 +0000 UTC m=+70.848227178" observedRunningTime="2026-06-03 13:48:49.327527017 +0000 UTC m=+71.939932335" watchObservedRunningTime="2026-06-03 13:48:49.328646615 +0000 UTC m=+71.941051931" Jun 03 13:48:49.347359 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.347316 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-n5r6c" podStartSLOduration=1.71179021 podStartE2EDuration="5.347304418s" podCreationTimestamp="2026-06-03 13:48:44 +0000 UTC" firstStartedPulling="2026-06-03 13:48:44.659487761 +0000 UTC m=+67.271893072" lastFinishedPulling="2026-06-03 13:48:48.295001979 +0000 UTC m=+70.907407280" observedRunningTime="2026-06-03 13:48:49.345556539 +0000 UTC m=+71.957961859" watchObservedRunningTime="2026-06-03 13:48:49.347304418 +0000 UTC m=+71.959709776" Jun 03 13:48:49.405049 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.404998 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-btzh4" podStartSLOduration=67.257003925 podStartE2EDuration="1m11.404984377s" podCreationTimestamp="2026-06-03 13:47:38 +0000 UTC" firstStartedPulling="2026-06-03 13:48:44.136403927 +0000 UTC m=+66.748809234" lastFinishedPulling="2026-06-03 13:48:48.284384389 +0000 UTC m=+70.896789686" observedRunningTime="2026-06-03 13:48:49.403614261 +0000 UTC m=+72.016019578" watchObservedRunningTime="2026-06-03 13:48:49.404984377 +0000 UTC m=+72.017389684" Jun 03 13:48:49.436909 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.436847 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-66b56fd745-9qzkk" podStartSLOduration=5.4368299669999995 podStartE2EDuration="5.436829967s" podCreationTimestamp="2026-06-03 13:48:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:48:49.436205981 +0000 UTC m=+72.048611309" watchObservedRunningTime="2026-06-03 13:48:49.436829967 +0000 UTC m=+72.049235285" Jun 03 13:48:49.479072 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.479014 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.894638167 podStartE2EDuration="9.479000679s" podCreationTimestamp="2026-06-03 13:48:40 +0000 UTC" firstStartedPulling="2026-06-03 13:48:41.664263543 +0000 UTC m=+64.276668849" lastFinishedPulling="2026-06-03 13:48:48.248626059 +0000 UTC m=+70.861031361" observedRunningTime="2026-06-03 13:48:49.478021864 +0000 UTC m=+72.090427179" watchObservedRunningTime="2026-06-03 13:48:49.479000679 +0000 UTC m=+72.091406030" Jun 03 13:48:49.548982 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.548924 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-96546579b-n89t2" podStartSLOduration=2.146581347 podStartE2EDuration="8.548910208s" podCreationTimestamp="2026-06-03 13:48:41 +0000 UTC" firstStartedPulling="2026-06-03 13:48:41.846292851 +0000 UTC m=+64.458698146" lastFinishedPulling="2026-06-03 13:48:48.248621697 +0000 UTC m=+70.861027007" observedRunningTime="2026-06-03 13:48:49.546295443 +0000 UTC m=+72.158700758" watchObservedRunningTime="2026-06-03 13:48:49.548910208 +0000 UTC m=+72.161315523" Jun 03 13:48:49.549156 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:49.549044 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" podStartSLOduration=2.836130026 podStartE2EDuration="6.549039509s" podCreationTimestamp="2026-06-03 13:48:43 +0000 UTC" firstStartedPulling="2026-06-03 13:48:44.539655607 +0000 UTC m=+67.152060904" lastFinishedPulling="2026-06-03 13:48:48.252565085 +0000 UTC m=+70.864970387" observedRunningTime="2026-06-03 13:48:49.512460779 +0000 UTC m=+72.124866098" watchObservedRunningTime="2026-06-03 13:48:49.549039509 +0000 UTC m=+72.161444824" Jun 03 13:48:52.340752 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:52.340715 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerStarted","Data":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} Jun 03 13:48:52.341126 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:52.340764 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerStarted","Data":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} Jun 03 13:48:53.346930 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:53.346894 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerStarted","Data":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} Jun 03 13:48:53.346930 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:53.346930 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerStarted","Data":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} Jun 03 13:48:53.346930 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:53.346939 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerStarted","Data":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} Jun 03 13:48:53.347400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:53.346948 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerStarted","Data":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} Jun 03 13:48:53.384392 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:53.384320 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.548336723 podStartE2EDuration="8.384297216s" podCreationTimestamp="2026-06-03 13:48:45 +0000 UTC" firstStartedPulling="2026-06-03 13:48:49.317453409 +0000 UTC m=+71.929858705" lastFinishedPulling="2026-06-03 13:48:52.153413901 +0000 UTC m=+74.765819198" observedRunningTime="2026-06-03 13:48:53.382636489 +0000 UTC m=+75.995041806" watchObservedRunningTime="2026-06-03 13:48:53.384297216 +0000 UTC m=+75.996702531" Jun 03 13:48:54.838637 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:54.838493 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:54.838637 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:54.838548 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:54.843438 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:54.843410 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:55.358501 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:55.358474 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:48:55.499098 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:55.499062 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c87d8b88-v9w9d"] Jun 03 13:48:56.190413 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:48:56.190374 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:49:04.382339 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:04.382311 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:49:04.382728 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:04.382392 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:49:17.326430 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:17.326396 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dgd9_47a1b9f5-a619-4a89-9b53-b0fd590813f2/serve-healthcheck-canary/0.log" Jun 03 13:49:20.328116 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.328084 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-btzh4" Jun 03 13:49:20.519181 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.519117 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-74c87d8b88-v9w9d" podUID="ffc9b149-38bf-45f0-a063-eca8a1379222" containerName="console" containerID="cri-o://2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc" gracePeriod=15 Jun 03 13:49:20.766258 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.766236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74c87d8b88-v9w9d_ffc9b149-38bf-45f0-a063-eca8a1379222/console/0.log" Jun 03 13:49:20.766391 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.766306 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:49:20.823009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.822973 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-oauth-serving-cert\") pod \"ffc9b149-38bf-45f0-a063-eca8a1379222\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " Jun 03 13:49:20.823009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823009 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-console-config\") pod \"ffc9b149-38bf-45f0-a063-eca8a1379222\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " Jun 03 13:49:20.823215 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823049 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-oauth-config\") pod \"ffc9b149-38bf-45f0-a063-eca8a1379222\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " Jun 03 13:49:20.823283 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823216 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-serving-cert\") pod \"ffc9b149-38bf-45f0-a063-eca8a1379222\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " Jun 03 13:49:20.823318 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823294 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-service-ca\") pod \"ffc9b149-38bf-45f0-a063-eca8a1379222\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " Jun 03 13:49:20.823351 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823328 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zkcw\" (UniqueName: \"kubernetes.io/projected/ffc9b149-38bf-45f0-a063-eca8a1379222-kube-api-access-2zkcw\") pod \"ffc9b149-38bf-45f0-a063-eca8a1379222\" (UID: \"ffc9b149-38bf-45f0-a063-eca8a1379222\") " Jun 03 13:49:20.823455 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823439 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffc9b149-38bf-45f0-a063-eca8a1379222" (UID: "ffc9b149-38bf-45f0-a063-eca8a1379222"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:49:20.823503 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823462 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-console-config" (OuterVolumeSpecName: "console-config") pod "ffc9b149-38bf-45f0-a063-eca8a1379222" (UID: "ffc9b149-38bf-45f0-a063-eca8a1379222"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:49:20.823670 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823650 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-oauth-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:49:20.823748 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823683 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-console-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:49:20.823748 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.823653 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffc9b149-38bf-45f0-a063-eca8a1379222" (UID: "ffc9b149-38bf-45f0-a063-eca8a1379222"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:49:20.825423 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.825397 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffc9b149-38bf-45f0-a063-eca8a1379222" (UID: "ffc9b149-38bf-45f0-a063-eca8a1379222"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:49:20.825544 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.825491 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc9b149-38bf-45f0-a063-eca8a1379222-kube-api-access-2zkcw" (OuterVolumeSpecName: "kube-api-access-2zkcw") pod "ffc9b149-38bf-45f0-a063-eca8a1379222" (UID: "ffc9b149-38bf-45f0-a063-eca8a1379222"). InnerVolumeSpecName "kube-api-access-2zkcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:49:20.825544 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.825494 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffc9b149-38bf-45f0-a063-eca8a1379222" (UID: "ffc9b149-38bf-45f0-a063-eca8a1379222"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:49:20.924267 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.924211 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-oauth-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:49:20.924439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.924267 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffc9b149-38bf-45f0-a063-eca8a1379222-console-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:49:20.924439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.924286 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc9b149-38bf-45f0-a063-eca8a1379222-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:49:20.924439 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:20.924299 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zkcw\" (UniqueName: \"kubernetes.io/projected/ffc9b149-38bf-45f0-a063-eca8a1379222-kube-api-access-2zkcw\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:49:21.430945 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.430918 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74c87d8b88-v9w9d_ffc9b149-38bf-45f0-a063-eca8a1379222/console/0.log" Jun 03 13:49:21.431454 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.430958 2562 generic.go:358] "Generic (PLEG): container finished" podID="ffc9b149-38bf-45f0-a063-eca8a1379222" containerID="2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc" exitCode=2 Jun 03 13:49:21.431454 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.430991 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c87d8b88-v9w9d" event={"ID":"ffc9b149-38bf-45f0-a063-eca8a1379222","Type":"ContainerDied","Data":"2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc"} Jun 03 13:49:21.431454 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.431019 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c87d8b88-v9w9d" Jun 03 13:49:21.431454 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.431034 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c87d8b88-v9w9d" event={"ID":"ffc9b149-38bf-45f0-a063-eca8a1379222","Type":"ContainerDied","Data":"fd942db23742e9e9b66efac741d4eb23886b5b634d71c81acb30b189d797ca14"} Jun 03 13:49:21.431454 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.431050 2562 scope.go:117] "RemoveContainer" containerID="2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc" Jun 03 13:49:21.439738 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.439717 2562 scope.go:117] "RemoveContainer" containerID="2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc" Jun 03 13:49:21.440002 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:49:21.439982 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc\": container with ID starting with 2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc not found: ID does not exist" containerID="2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc" Jun 03 13:49:21.440052 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.440011 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc"} err="failed to get container status \"2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc\": rpc error: code = NotFound desc = could not find container \"2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc\": container with ID starting with 2113b42589e06d2c7e7c42b834efa537668330902c69951e4fe3c33f76c430dc not found: ID does not exist" Jun 03 13:49:21.454343 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.454308 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c87d8b88-v9w9d"] Jun 03 13:49:21.458004 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.457971 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c87d8b88-v9w9d"] Jun 03 13:49:21.998785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:21.998745 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffc9b149-38bf-45f0-a063-eca8a1379222" path="/var/lib/kubelet/pods/ffc9b149-38bf-45f0-a063-eca8a1379222/volumes" Jun 03 13:49:24.388128 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:24.388093 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:49:24.391952 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:24.391931 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8f678b84d-j4qb2" Jun 03 13:49:46.190657 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:46.190618 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:49:46.210377 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:46.210351 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:49:46.519855 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:46.519785 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:49:59.856610 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:59.856573 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:49:59.857082 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:59.857020 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="alertmanager" containerID="cri-o://da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668" gracePeriod=120 Jun 03 13:49:59.857163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:59.857083 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-metric" containerID="cri-o://cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835" gracePeriod=120 Jun 03 13:49:59.857163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:59.857148 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="prom-label-proxy" containerID="cri-o://72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f" gracePeriod=120 Jun 03 13:49:59.857294 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:59.857127 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-web" containerID="cri-o://112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6" gracePeriod=120 Jun 03 13:49:59.857294 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:59.857160 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="config-reloader" containerID="cri-o://d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252" gracePeriod=120 Jun 03 13:49:59.857294 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:49:59.857236 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy" containerID="cri-o://b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc" gracePeriod=120 Jun 03 13:50:00.544975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.544942 2562 generic.go:358] "Generic (PLEG): container finished" podID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerID="72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f" exitCode=0 Jun 03 13:50:00.544975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.544968 2562 generic.go:358] "Generic (PLEG): container finished" podID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerID="b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc" exitCode=0 Jun 03 13:50:00.544975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.544975 2562 generic.go:358] "Generic (PLEG): container finished" podID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerID="d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252" exitCode=0 Jun 03 13:50:00.544975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.544980 2562 generic.go:358] "Generic (PLEG): container finished" podID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerID="da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668" exitCode=0 Jun 03 13:50:00.545269 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.545010 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f"} Jun 03 13:50:00.545269 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.545048 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc"} Jun 03 13:50:00.545269 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.545058 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252"} Jun 03 13:50:00.545269 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:00.545066 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668"} Jun 03 13:50:01.098100 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.098072 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.281967 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.281933 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g84vm\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-kube-api-access-g84vm\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.281990 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282019 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-web\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282051 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-config-out\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282068 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282085 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-cluster-tls-config\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282150 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-config-volume\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282511 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282175 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-main-db\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282511 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282250 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282616 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282516 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-metrics-client-ca\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282616 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282553 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-tls-assets\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282616 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282586 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-web-config\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.282762 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282626 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"57f5ad2f-059b-4f10-bc93-1d463361acde\" (UID: \"57f5ad2f-059b-4f10-bc93-1d463361acde\") " Jun 03 13:50:01.283619 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.282866 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:50:01.283619 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.283162 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:01.283619 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.283580 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:01.285370 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.285324 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-config-volume" (OuterVolumeSpecName: "config-volume") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:01.285490 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.285403 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-kube-api-access-g84vm" (OuterVolumeSpecName: "kube-api-access-g84vm") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "kube-api-access-g84vm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:50:01.285563 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.285497 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:01.285638 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.285610 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:01.286006 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.285979 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:01.286089 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.286061 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-config-out" (OuterVolumeSpecName: "config-out") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:50:01.286310 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.286291 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:50:01.286390 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.286309 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:01.289669 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.289645 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:01.297685 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.297662 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-web-config" (OuterVolumeSpecName: "web-config") pod "57f5ad2f-059b-4f10-bc93-1d463361acde" (UID: "57f5ad2f-059b-4f10-bc93-1d463361acde"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:01.384010 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.383972 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-config-volume\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384010 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384006 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-main-db\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384010 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384018 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384029 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f5ad2f-059b-4f10-bc93-1d463361acde-metrics-client-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384038 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-tls-assets\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384047 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-web-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384055 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384065 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g84vm\" (UniqueName: \"kubernetes.io/projected/57f5ad2f-059b-4f10-bc93-1d463361acde-kube-api-access-g84vm\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384074 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-main-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384083 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384091 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f5ad2f-059b-4f10-bc93-1d463361acde-config-out\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384101 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.384271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.384110 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57f5ad2f-059b-4f10-bc93-1d463361acde-cluster-tls-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:01.550258 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.550156 2562 generic.go:358] "Generic (PLEG): container finished" podID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerID="cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835" exitCode=0 Jun 03 13:50:01.550258 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.550182 2562 generic.go:358] "Generic (PLEG): container finished" podID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerID="112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6" exitCode=0 Jun 03 13:50:01.550444 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.550253 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835"} Jun 03 13:50:01.550444 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.550282 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.550444 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.550301 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6"} Jun 03 13:50:01.550444 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.550322 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57f5ad2f-059b-4f10-bc93-1d463361acde","Type":"ContainerDied","Data":"8eb161ddd17b09c3e7b948d17e2b363a26804bf4326a6902f4305faaaef676ab"} Jun 03 13:50:01.550444 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.550341 2562 scope.go:117] "RemoveContainer" containerID="72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f" Jun 03 13:50:01.557825 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.557801 2562 scope.go:117] "RemoveContainer" containerID="cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835" Jun 03 13:50:01.564727 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.564705 2562 scope.go:117] "RemoveContainer" containerID="b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc" Jun 03 13:50:01.571057 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.571041 2562 scope.go:117] "RemoveContainer" containerID="112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6" Jun 03 13:50:01.577307 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.577285 2562 scope.go:117] "RemoveContainer" containerID="d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252" Jun 03 13:50:01.584343 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.584195 2562 scope.go:117] "RemoveContainer" containerID="da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668" Jun 03 13:50:01.585667 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.585645 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:50:01.592761 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.592740 2562 scope.go:117] "RemoveContainer" containerID="4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28" Jun 03 13:50:01.593699 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.593681 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:50:01.599100 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.599083 2562 scope.go:117] "RemoveContainer" containerID="72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f" Jun 03 13:50:01.599432 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:01.599412 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f\": container with ID starting with 72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f not found: ID does not exist" containerID="72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f" Jun 03 13:50:01.599482 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.599444 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f"} err="failed to get container status \"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f\": rpc error: code = NotFound desc = could not find container \"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f\": container with ID starting with 72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f not found: ID does not exist" Jun 03 13:50:01.599482 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.599465 2562 scope.go:117] "RemoveContainer" containerID="cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835" Jun 03 13:50:01.599704 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:01.599681 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835\": container with ID starting with cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835 not found: ID does not exist" containerID="cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835" Jun 03 13:50:01.599753 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.599707 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835"} err="failed to get container status \"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835\": rpc error: code = NotFound desc = could not find container \"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835\": container with ID starting with cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835 not found: ID does not exist" Jun 03 13:50:01.599753 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.599728 2562 scope.go:117] "RemoveContainer" containerID="b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc" Jun 03 13:50:01.599919 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:01.599905 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc\": container with ID starting with b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc not found: ID does not exist" containerID="b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc" Jun 03 13:50:01.599963 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.599922 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc"} err="failed to get container status \"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc\": rpc error: code = NotFound desc = could not find container \"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc\": container with ID starting with b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc not found: ID does not exist" Jun 03 13:50:01.599963 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.599935 2562 scope.go:117] "RemoveContainer" containerID="112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6" Jun 03 13:50:01.600143 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:01.600126 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6\": container with ID starting with 112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6 not found: ID does not exist" containerID="112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6" Jun 03 13:50:01.600191 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600147 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6"} err="failed to get container status \"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6\": rpc error: code = NotFound desc = could not find container \"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6\": container with ID starting with 112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6 not found: ID does not exist" Jun 03 13:50:01.600191 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600161 2562 scope.go:117] "RemoveContainer" containerID="d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252" Jun 03 13:50:01.600411 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:01.600394 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252\": container with ID starting with d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252 not found: ID does not exist" containerID="d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252" Jun 03 13:50:01.600463 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600414 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252"} err="failed to get container status \"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252\": rpc error: code = NotFound desc = could not find container \"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252\": container with ID starting with d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252 not found: ID does not exist" Jun 03 13:50:01.600463 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600428 2562 scope.go:117] "RemoveContainer" containerID="da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668" Jun 03 13:50:01.600665 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:01.600649 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668\": container with ID starting with da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668 not found: ID does not exist" containerID="da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668" Jun 03 13:50:01.600698 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600668 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668"} err="failed to get container status \"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668\": rpc error: code = NotFound desc = could not find container \"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668\": container with ID starting with da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668 not found: ID does not exist" Jun 03 13:50:01.600698 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600683 2562 scope.go:117] "RemoveContainer" containerID="4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28" Jun 03 13:50:01.600883 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:01.600868 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28\": container with ID starting with 4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28 not found: ID does not exist" containerID="4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28" Jun 03 13:50:01.600920 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600887 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28"} err="failed to get container status \"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28\": rpc error: code = NotFound desc = could not find container \"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28\": container with ID starting with 4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28 not found: ID does not exist" Jun 03 13:50:01.600920 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.600899 2562 scope.go:117] "RemoveContainer" containerID="72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f" Jun 03 13:50:01.601096 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601080 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f"} err="failed to get container status \"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f\": rpc error: code = NotFound desc = could not find container \"72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f\": container with ID starting with 72554c3bf0b3fb0fdfd55742bbace4b362f6e31635e5cf32c8181e584c7e843f not found: ID does not exist" Jun 03 13:50:01.601132 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601097 2562 scope.go:117] "RemoveContainer" containerID="cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835" Jun 03 13:50:01.601299 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601283 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835"} err="failed to get container status \"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835\": rpc error: code = NotFound desc = could not find container \"cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835\": container with ID starting with cd0fb76d573f88a1728a4b24960681b765e146ab61fbe212010487f481122835 not found: ID does not exist" Jun 03 13:50:01.601348 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601300 2562 scope.go:117] "RemoveContainer" containerID="b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc" Jun 03 13:50:01.601474 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601460 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc"} err="failed to get container status \"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc\": rpc error: code = NotFound desc = could not find container \"b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc\": container with ID starting with b6c9cb47833a3ce227c8e45d0e6f9486b83fa53f65a5cc700db29474086f0dcc not found: ID does not exist" Jun 03 13:50:01.601518 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601475 2562 scope.go:117] "RemoveContainer" containerID="112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6" Jun 03 13:50:01.601646 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601628 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6"} err="failed to get container status \"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6\": rpc error: code = NotFound desc = could not find container \"112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6\": container with ID starting with 112fa76eb7dd5b1b789c9b035988679dde337c7eb933db3f3484efeff652a8e6 not found: ID does not exist" Jun 03 13:50:01.601682 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601648 2562 scope.go:117] "RemoveContainer" containerID="d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252" Jun 03 13:50:01.601816 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601803 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252"} err="failed to get container status \"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252\": rpc error: code = NotFound desc = could not find container \"d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252\": container with ID starting with d09c10eb7c0462625824b35aba574eaba093d5d6efc267dfe6ee034bcd7b8252 not found: ID does not exist" Jun 03 13:50:01.601854 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601817 2562 scope.go:117] "RemoveContainer" containerID="da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668" Jun 03 13:50:01.601996 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601980 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668"} err="failed to get container status \"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668\": rpc error: code = NotFound desc = could not find container \"da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668\": container with ID starting with da5dac8f5f3d94939aeae7e6d76e218e3719d27b92b2002a99640d3fecbb2668 not found: ID does not exist" Jun 03 13:50:01.602034 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.601998 2562 scope.go:117] "RemoveContainer" containerID="4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28" Jun 03 13:50:01.602237 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.602205 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28"} err="failed to get container status \"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28\": rpc error: code = NotFound desc = could not find container \"4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28\": container with ID starting with 4ef6db24a24de1e2b04cad425d2361a8c84b2483e2569fada6ced5ce0a636f28 not found: ID does not exist" Jun 03 13:50:01.656729 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.656693 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:50:01.657016 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657003 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="config-reloader" Jun 03 13:50:01.657060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657019 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="config-reloader" Jun 03 13:50:01.657060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657032 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="init-config-reloader" Jun 03 13:50:01.657060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657041 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="init-config-reloader" Jun 03 13:50:01.657060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657048 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy" Jun 03 13:50:01.657060 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657054 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657066 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc9b149-38bf-45f0-a063-eca8a1379222" containerName="console" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657075 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc9b149-38bf-45f0-a063-eca8a1379222" containerName="console" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657084 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-metric" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657090 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-metric" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657095 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="prom-label-proxy" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657100 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="prom-label-proxy" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657112 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="alertmanager" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657117 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="alertmanager" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657123 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-web" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657127 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-web" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657175 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-web" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657185 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffc9b149-38bf-45f0-a063-eca8a1379222" containerName="console" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657192 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="alertmanager" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657197 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy-metric" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657203 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="prom-label-proxy" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657208 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="kube-rbac-proxy" Jun 03 13:50:01.657271 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.657216 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" containerName="config-reloader" Jun 03 13:50:01.662575 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.662559 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.665431 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665395 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-92zlc\"" Jun 03 13:50:01.665431 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665425 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 13:50:01.665615 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665398 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 13:50:01.665615 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665484 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 13:50:01.665615 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665550 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 13:50:01.665746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665726 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 13:50:01.665810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665766 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 13:50:01.665810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665793 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 13:50:01.665920 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.665859 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 13:50:01.672626 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.672591 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 13:50:01.675397 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.675366 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:50:01.686923 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.686894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.686929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.686946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b8aedd4-7454-4f7b-92db-68b57c001b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687182 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b8aedd4-7454-4f7b-92db-68b57c001b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687182 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687182 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b8aedd4-7454-4f7b-92db-68b57c001b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687182 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687327 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b8aedd4-7454-4f7b-92db-68b57c001b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687327 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b8aedd4-7454-4f7b-92db-68b57c001b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687327 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsjnd\" (UniqueName: \"kubernetes.io/projected/4b8aedd4-7454-4f7b-92db-68b57c001b8a-kube-api-access-dsjnd\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.687417 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.687335 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.787734 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.787691 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.787734 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.787740 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.787955 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.787764 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788034 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788011 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b8aedd4-7454-4f7b-92db-68b57c001b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788104 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788078 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788147 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788109 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b8aedd4-7454-4f7b-92db-68b57c001b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788147 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788140 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788186 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b8aedd4-7454-4f7b-92db-68b57c001b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788247 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788296 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b8aedd4-7454-4f7b-92db-68b57c001b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.788358 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788354 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b8aedd4-7454-4f7b-92db-68b57c001b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.790359 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788387 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsjnd\" (UniqueName: \"kubernetes.io/projected/4b8aedd4-7454-4f7b-92db-68b57c001b8a-kube-api-access-dsjnd\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.790359 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.788431 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.790359 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.789078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b8aedd4-7454-4f7b-92db-68b57c001b8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.790359 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.789562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b8aedd4-7454-4f7b-92db-68b57c001b8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.790359 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.789802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b8aedd4-7454-4f7b-92db-68b57c001b8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.791443 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.791073 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.791443 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.791162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.791443 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.791267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b8aedd4-7454-4f7b-92db-68b57c001b8a-config-out\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.791782 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.791761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.792124 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.792106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b8aedd4-7454-4f7b-92db-68b57c001b8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.792438 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.792412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.792558 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.792540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.792829 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.792811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.792893 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.792816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b8aedd4-7454-4f7b-92db-68b57c001b8a-web-config\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.800318 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.800258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsjnd\" (UniqueName: \"kubernetes.io/projected/4b8aedd4-7454-4f7b-92db-68b57c001b8a-kube-api-access-dsjnd\") pod \"alertmanager-main-0\" (UID: \"4b8aedd4-7454-4f7b-92db-68b57c001b8a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.972971 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.972931 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:50:01.998505 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:01.998472 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57f5ad2f-059b-4f10-bc93-1d463361acde" path="/var/lib/kubelet/pods/57f5ad2f-059b-4f10-bc93-1d463361acde/volumes" Jun 03 13:50:02.116715 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:02.116603 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:50:02.119509 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:50:02.119480 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8aedd4_7454_4f7b_92db_68b57c001b8a.slice/crio-1643a5d8744352901d21d310ec3b986da23dde0fd4cc24ce682da766888fda39 WatchSource:0}: Error finding container 1643a5d8744352901d21d310ec3b986da23dde0fd4cc24ce682da766888fda39: Status 404 returned error can't find the container with id 1643a5d8744352901d21d310ec3b986da23dde0fd4cc24ce682da766888fda39 Jun 03 13:50:02.554602 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:02.554569 2562 generic.go:358] "Generic (PLEG): container finished" podID="4b8aedd4-7454-4f7b-92db-68b57c001b8a" containerID="efd7a2f57b33450bb4910c86f34e4565f6d2afb4ba84c26916d460500be5c71c" exitCode=0 Jun 03 13:50:02.554804 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:02.554658 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerDied","Data":"efd7a2f57b33450bb4910c86f34e4565f6d2afb4ba84c26916d460500be5c71c"} Jun 03 13:50:02.554804 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:02.554688 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerStarted","Data":"1643a5d8744352901d21d310ec3b986da23dde0fd4cc24ce682da766888fda39"} Jun 03 13:50:03.561891 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.561851 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerStarted","Data":"1ff5d6e2414bd8eb6d0aa01e177d529ff2ae5c45c44fb0eda3fc80879eaa11e8"} Jun 03 13:50:03.562292 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.561898 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerStarted","Data":"4c9e1ee0ca5f4b7406f6c2c0e18fec589b67e5d97937e13c5d6d35a8ead3d512"} Jun 03 13:50:03.562292 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.561913 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerStarted","Data":"b5c14ad01019b51a2f7a524b4d7251b9436f0c1b3de0211a19c64817741a56fb"} Jun 03 13:50:03.562292 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.561928 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerStarted","Data":"7488c0ab9ae0356479000fe99337fe3896e4e14c753a57ea9240694a2050bd00"} Jun 03 13:50:03.562292 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.561939 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerStarted","Data":"44275d501289f0c226ac4c7a485b01da383b9bbd7361034219dc432319686d68"} Jun 03 13:50:03.562292 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.561952 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b8aedd4-7454-4f7b-92db-68b57c001b8a","Type":"ContainerStarted","Data":"ecc9bbd6f9bd7e6fc10ab369041cb6f69cf5aa0561e66a61dd34148634225fab"} Jun 03 13:50:03.595578 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.595528 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.595511607 podStartE2EDuration="2.595511607s" podCreationTimestamp="2026-06-03 13:50:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:50:03.593977259 +0000 UTC m=+146.206382579" watchObservedRunningTime="2026-06-03 13:50:03.595511607 +0000 UTC m=+146.207916924" Jun 03 13:50:03.893069 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.892977 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f97b45f58-b6jfg"] Jun 03 13:50:03.896759 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.896735 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.901242 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.901188 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 13:50:03.901417 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.901399 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xwqnl\"" Jun 03 13:50:03.901580 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.901563 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 13:50:03.901877 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.901861 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 13:50:03.901987 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.901973 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 13:50:03.904735 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.904712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-telemeter-client-tls\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.904851 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.904833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-metrics-client-ca\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.904851 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.904838 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 13:50:03.904983 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.904888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.904983 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.904943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.904983 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.904972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn4gd\" (UniqueName: \"kubernetes.io/projected/8c98603e-f86a-4df9-b35b-b0f6524933db-kube-api-access-pn4gd\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.905094 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.905019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-secret-telemeter-client\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.905094 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.905052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-federate-client-tls\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.905186 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.905164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-serving-certs-ca-bundle\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:03.911205 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.911179 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 13:50:03.913443 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:03.913412 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f97b45f58-b6jfg"] Jun 03 13:50:04.005910 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.005867 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-secret-telemeter-client\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.005910 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.005913 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-federate-client-tls\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.005963 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-serving-certs-ca-bundle\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.005994 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-telemeter-client-tls\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.006044 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-metrics-client-ca\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.006073 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.006112 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.006138 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pn4gd\" (UniqueName: \"kubernetes.io/projected/8c98603e-f86a-4df9-b35b-b0f6524933db-kube-api-access-pn4gd\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006814 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.006784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-serving-certs-ca-bundle\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.006940 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.006812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-metrics-client-ca\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.007147 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.007123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c98603e-f86a-4df9-b35b-b0f6524933db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.008655 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.008635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-federate-client-tls\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.008929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.008908 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-secret-telemeter-client\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.008987 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.008974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-telemeter-client-tls\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.009024 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.008987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c98603e-f86a-4df9-b35b-b0f6524933db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.026230 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.026188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn4gd\" (UniqueName: \"kubernetes.io/projected/8c98603e-f86a-4df9-b35b-b0f6524933db-kube-api-access-pn4gd\") pod \"telemeter-client-7f97b45f58-b6jfg\" (UID: \"8c98603e-f86a-4df9-b35b-b0f6524933db\") " pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.207759 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.207720 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" Jun 03 13:50:04.265895 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.265858 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:50:04.270705 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.267366 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="prometheus" containerID="cri-o://8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" gracePeriod=600 Jun 03 13:50:04.270705 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.267740 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy" containerID="cri-o://409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" gracePeriod=600 Jun 03 13:50:04.270705 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.267785 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="config-reloader" containerID="cri-o://f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" gracePeriod=600 Jun 03 13:50:04.270705 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.267384 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-thanos" containerID="cri-o://af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" gracePeriod=600 Jun 03 13:50:04.270705 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.268068 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-web" containerID="cri-o://ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" gracePeriod=600 Jun 03 13:50:04.270705 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.268454 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="thanos-sidecar" containerID="cri-o://bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" gracePeriod=600 Jun 03 13:50:04.390546 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.390512 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f97b45f58-b6jfg"] Jun 03 13:50:04.401179 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:50:04.401149 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c98603e_f86a_4df9_b35b_b0f6524933db.slice/crio-d1f28829f40ee8043af2a8e3c79769c9f09178ba7f2f6b3975598abfe1eba817 WatchSource:0}: Error finding container d1f28829f40ee8043af2a8e3c79769c9f09178ba7f2f6b3975598abfe1eba817: Status 404 returned error can't find the container with id d1f28829f40ee8043af2a8e3c79769c9f09178ba7f2f6b3975598abfe1eba817 Jun 03 13:50:04.536749 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.536721 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:04.566703 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.566651 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" event={"ID":"8c98603e-f86a-4df9-b35b-b0f6524933db","Type":"ContainerStarted","Data":"d1f28829f40ee8043af2a8e3c79769c9f09178ba7f2f6b3975598abfe1eba817"} Jun 03 13:50:04.569990 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.569953 2562 generic.go:358] "Generic (PLEG): container finished" podID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" exitCode=0 Jun 03 13:50:04.569990 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.569981 2562 generic.go:358] "Generic (PLEG): container finished" podID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" exitCode=0 Jun 03 13:50:04.569990 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.569994 2562 generic.go:358] "Generic (PLEG): container finished" podID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" exitCode=0 Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570003 2562 generic.go:358] "Generic (PLEG): container finished" podID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" exitCode=0 Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570012 2562 generic.go:358] "Generic (PLEG): container finished" podID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" exitCode=0 Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570021 2562 generic.go:358] "Generic (PLEG): container finished" podID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" exitCode=0 Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570011 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570063 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570077 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570086 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570099 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570103 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570112 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570126 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e999bbb-70cb-43e1-a18a-6b81bfe79098","Type":"ContainerDied","Data":"9a6735e4f015fc7f18ef434c698daa71ff97bedacacbd81e6bad946e62dbc678"} Jun 03 13:50:04.570264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.570136 2562 scope.go:117] "RemoveContainer" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.578317 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.578296 2562 scope.go:117] "RemoveContainer" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.586967 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.586943 2562 scope.go:117] "RemoveContainer" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.596750 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.596694 2562 scope.go:117] "RemoveContainer" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.604533 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.604512 2562 scope.go:117] "RemoveContainer" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.611922 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.611890 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-grpc-tls\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612062 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.611948 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config-out\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612062 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.611979 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-rulefiles-0\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612062 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612008 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-metrics-client-certs\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612062 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612041 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612205 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612071 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-thanos-prometheus-http-client-file\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612205 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612125 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5xxc\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-kube-api-access-n5xxc\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612205 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612199 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-metrics-client-ca\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612344 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612264 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-db\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612344 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612291 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-web-config\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612344 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612341 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612462 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612395 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-tls\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612462 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612422 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-trusted-ca-bundle\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612555 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612463 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-serving-certs-ca-bundle\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612555 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612500 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-kubelet-serving-ca-bundle\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612555 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612538 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-tls-assets\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612698 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612569 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.612698 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.612601 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-kube-rbac-proxy\") pod \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\" (UID: \"5e999bbb-70cb-43e1-a18a-6b81bfe79098\") " Jun 03 13:50:04.614413 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.614376 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:04.616740 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.615983 2562 scope.go:117] "RemoveContainer" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.618619 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.617486 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-kube-api-access-n5xxc" (OuterVolumeSpecName: "kube-api-access-n5xxc") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "kube-api-access-n5xxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:50:04.618619 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.618177 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:50:04.619023 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.618807 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:04.619207 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.619165 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:04.619519 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.619490 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:04.619593 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.619554 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.619860 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.619791 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:04.620512 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.620478 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.620779 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.620676 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config-out" (OuterVolumeSpecName: "config-out") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:50:04.621042 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.621008 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.622570 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.622529 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.622655 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.622587 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config" (OuterVolumeSpecName: "config") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.622655 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.622609 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:50:04.622779 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.622697 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.622779 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.622721 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.622971 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.622946 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.632623 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.630775 2562 scope.go:117] "RemoveContainer" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.639164 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.639132 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-web-config" (OuterVolumeSpecName: "web-config") pod "5e999bbb-70cb-43e1-a18a-6b81bfe79098" (UID: "5e999bbb-70cb-43e1-a18a-6b81bfe79098"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:04.640465 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.640441 2562 scope.go:117] "RemoveContainer" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.640830 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:04.640807 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": container with ID starting with af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496 not found: ID does not exist" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.640924 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.640839 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} err="failed to get container status \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": rpc error: code = NotFound desc = could not find container \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": container with ID starting with af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496 not found: ID does not exist" Jun 03 13:50:04.640924 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.640867 2562 scope.go:117] "RemoveContainer" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.641153 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:04.641134 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": container with ID starting with 409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec not found: ID does not exist" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.641235 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.641155 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} err="failed to get container status \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": rpc error: code = NotFound desc = could not find container \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": container with ID starting with 409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec not found: ID does not exist" Jun 03 13:50:04.641235 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.641174 2562 scope.go:117] "RemoveContainer" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.641435 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:04.641413 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": container with ID starting with ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6 not found: ID does not exist" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.641517 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.641442 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} err="failed to get container status \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": rpc error: code = NotFound desc = could not find container \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": container with ID starting with ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6 not found: ID does not exist" Jun 03 13:50:04.641517 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.641462 2562 scope.go:117] "RemoveContainer" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.641768 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:04.641747 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": container with ID starting with bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150 not found: ID does not exist" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.641847 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.641771 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} err="failed to get container status \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": rpc error: code = NotFound desc = could not find container \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": container with ID starting with bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150 not found: ID does not exist" Jun 03 13:50:04.641847 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.641799 2562 scope.go:117] "RemoveContainer" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.642048 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:04.642016 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": container with ID starting with f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef not found: ID does not exist" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.642126 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642050 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} err="failed to get container status \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": rpc error: code = NotFound desc = could not find container \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": container with ID starting with f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef not found: ID does not exist" Jun 03 13:50:04.642126 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642066 2562 scope.go:117] "RemoveContainer" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.642343 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:04.642323 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": container with ID starting with 8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629 not found: ID does not exist" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.642443 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642346 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} err="failed to get container status \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": rpc error: code = NotFound desc = could not find container \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": container with ID starting with 8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629 not found: ID does not exist" Jun 03 13:50:04.642443 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642358 2562 scope.go:117] "RemoveContainer" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.642617 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:04.642593 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": container with ID starting with 5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f not found: ID does not exist" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.642672 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642620 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f"} err="failed to get container status \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": rpc error: code = NotFound desc = could not find container \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": container with ID starting with 5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f not found: ID does not exist" Jun 03 13:50:04.642672 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642632 2562 scope.go:117] "RemoveContainer" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.642905 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642881 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} err="failed to get container status \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": rpc error: code = NotFound desc = could not find container \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": container with ID starting with af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496 not found: ID does not exist" Jun 03 13:50:04.642973 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.642907 2562 scope.go:117] "RemoveContainer" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.643196 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643178 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} err="failed to get container status \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": rpc error: code = NotFound desc = could not find container \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": container with ID starting with 409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec not found: ID does not exist" Jun 03 13:50:04.643274 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643198 2562 scope.go:117] "RemoveContainer" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.643504 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643474 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} err="failed to get container status \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": rpc error: code = NotFound desc = could not find container \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": container with ID starting with ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6 not found: ID does not exist" Jun 03 13:50:04.643587 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643505 2562 scope.go:117] "RemoveContainer" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.643810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643719 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} err="failed to get container status \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": rpc error: code = NotFound desc = could not find container \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": container with ID starting with bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150 not found: ID does not exist" Jun 03 13:50:04.643810 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643743 2562 scope.go:117] "RemoveContainer" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.643985 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643956 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} err="failed to get container status \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": rpc error: code = NotFound desc = could not find container \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": container with ID starting with f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef not found: ID does not exist" Jun 03 13:50:04.644050 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.643988 2562 scope.go:117] "RemoveContainer" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.644332 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.644279 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} err="failed to get container status \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": rpc error: code = NotFound desc = could not find container \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": container with ID starting with 8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629 not found: ID does not exist" Jun 03 13:50:04.644332 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.644304 2562 scope.go:117] "RemoveContainer" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.644578 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.644547 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f"} err="failed to get container status \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": rpc error: code = NotFound desc = could not find container \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": container with ID starting with 5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f not found: ID does not exist" Jun 03 13:50:04.644657 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.644583 2562 scope.go:117] "RemoveContainer" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.644847 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.644824 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} err="failed to get container status \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": rpc error: code = NotFound desc = could not find container \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": container with ID starting with af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496 not found: ID does not exist" Jun 03 13:50:04.644917 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.644848 2562 scope.go:117] "RemoveContainer" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.645252 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} err="failed to get container status \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": rpc error: code = NotFound desc = could not find container \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": container with ID starting with 409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec not found: ID does not exist" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.645283 2562 scope.go:117] "RemoveContainer" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.645509 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} err="failed to get container status \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": rpc error: code = NotFound desc = could not find container \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": container with ID starting with ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6 not found: ID does not exist" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.645530 2562 scope.go:117] "RemoveContainer" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.645780 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} err="failed to get container status \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": rpc error: code = NotFound desc = could not find container \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": container with ID starting with bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150 not found: ID does not exist" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.645802 2562 scope.go:117] "RemoveContainer" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.645989 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} err="failed to get container status \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": rpc error: code = NotFound desc = could not find container \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": container with ID starting with f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef not found: ID does not exist" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.646008 2562 scope.go:117] "RemoveContainer" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.646187 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} err="failed to get container status \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": rpc error: code = NotFound desc = could not find container \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": container with ID starting with 8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629 not found: ID does not exist" Jun 03 13:50:04.646316 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.646208 2562 scope.go:117] "RemoveContainer" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.646683 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.646553 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f"} err="failed to get container status \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": rpc error: code = NotFound desc = could not find container \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": container with ID starting with 5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f not found: ID does not exist" Jun 03 13:50:04.646683 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.646576 2562 scope.go:117] "RemoveContainer" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.646837 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.646817 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} err="failed to get container status \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": rpc error: code = NotFound desc = could not find container \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": container with ID starting with af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496 not found: ID does not exist" Jun 03 13:50:04.646909 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.646837 2562 scope.go:117] "RemoveContainer" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.647082 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647054 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} err="failed to get container status \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": rpc error: code = NotFound desc = could not find container \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": container with ID starting with 409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec not found: ID does not exist" Jun 03 13:50:04.647159 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647084 2562 scope.go:117] "RemoveContainer" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.647414 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647393 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} err="failed to get container status \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": rpc error: code = NotFound desc = could not find container \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": container with ID starting with ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6 not found: ID does not exist" Jun 03 13:50:04.647479 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647416 2562 scope.go:117] "RemoveContainer" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.647653 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647635 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} err="failed to get container status \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": rpc error: code = NotFound desc = could not find container \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": container with ID starting with bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150 not found: ID does not exist" Jun 03 13:50:04.647694 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647654 2562 scope.go:117] "RemoveContainer" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.647880 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647859 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} err="failed to get container status \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": rpc error: code = NotFound desc = could not find container \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": container with ID starting with f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef not found: ID does not exist" Jun 03 13:50:04.647952 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.647882 2562 scope.go:117] "RemoveContainer" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.648103 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648086 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} err="failed to get container status \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": rpc error: code = NotFound desc = could not find container \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": container with ID starting with 8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629 not found: ID does not exist" Jun 03 13:50:04.648174 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648105 2562 scope.go:117] "RemoveContainer" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.648354 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648335 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f"} err="failed to get container status \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": rpc error: code = NotFound desc = could not find container \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": container with ID starting with 5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f not found: ID does not exist" Jun 03 13:50:04.648429 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648356 2562 scope.go:117] "RemoveContainer" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.648597 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648575 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} err="failed to get container status \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": rpc error: code = NotFound desc = could not find container \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": container with ID starting with af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496 not found: ID does not exist" Jun 03 13:50:04.648645 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648599 2562 scope.go:117] "RemoveContainer" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.648832 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648810 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} err="failed to get container status \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": rpc error: code = NotFound desc = could not find container \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": container with ID starting with 409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec not found: ID does not exist" Jun 03 13:50:04.648907 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.648834 2562 scope.go:117] "RemoveContainer" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.649065 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649047 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} err="failed to get container status \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": rpc error: code = NotFound desc = could not find container \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": container with ID starting with ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6 not found: ID does not exist" Jun 03 13:50:04.649115 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649065 2562 scope.go:117] "RemoveContainer" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.649355 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649336 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} err="failed to get container status \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": rpc error: code = NotFound desc = could not find container \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": container with ID starting with bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150 not found: ID does not exist" Jun 03 13:50:04.649403 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649356 2562 scope.go:117] "RemoveContainer" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.649572 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649554 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} err="failed to get container status \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": rpc error: code = NotFound desc = could not find container \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": container with ID starting with f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef not found: ID does not exist" Jun 03 13:50:04.649639 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649573 2562 scope.go:117] "RemoveContainer" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.649787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649770 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} err="failed to get container status \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": rpc error: code = NotFound desc = could not find container \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": container with ID starting with 8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629 not found: ID does not exist" Jun 03 13:50:04.649787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649786 2562 scope.go:117] "RemoveContainer" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.649980 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649964 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f"} err="failed to get container status \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": rpc error: code = NotFound desc = could not find container \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": container with ID starting with 5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f not found: ID does not exist" Jun 03 13:50:04.650039 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.649980 2562 scope.go:117] "RemoveContainer" containerID="af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496" Jun 03 13:50:04.650248 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650206 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496"} err="failed to get container status \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": rpc error: code = NotFound desc = could not find container \"af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496\": container with ID starting with af5bb359f78b6e221b2a601ac3b8073b1952b411332a2f8fd445d3793e64f496 not found: ID does not exist" Jun 03 13:50:04.650248 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650247 2562 scope.go:117] "RemoveContainer" containerID="409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec" Jun 03 13:50:04.650491 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650469 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec"} err="failed to get container status \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": rpc error: code = NotFound desc = could not find container \"409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec\": container with ID starting with 409795d467d77d19bbe6035b62d0d183fca54f2f432c7256a2eafb606c3179ec not found: ID does not exist" Jun 03 13:50:04.650491 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650489 2562 scope.go:117] "RemoveContainer" containerID="ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6" Jun 03 13:50:04.650746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650721 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6"} err="failed to get container status \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": rpc error: code = NotFound desc = could not find container \"ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6\": container with ID starting with ca0660af75336a528117eb48171cdcc2c062ab3821a0e5a9988538f0a08680e6 not found: ID does not exist" Jun 03 13:50:04.650869 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650748 2562 scope.go:117] "RemoveContainer" containerID="bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150" Jun 03 13:50:04.650985 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650960 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150"} err="failed to get container status \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": rpc error: code = NotFound desc = could not find container \"bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150\": container with ID starting with bf2312c0bea7cabf355f75358f2877d8f1cf549ea3eea59befe3b5bb60871150 not found: ID does not exist" Jun 03 13:50:04.651043 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.650986 2562 scope.go:117] "RemoveContainer" containerID="f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef" Jun 03 13:50:04.651239 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.651202 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef"} err="failed to get container status \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": rpc error: code = NotFound desc = could not find container \"f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef\": container with ID starting with f62b7b3444d3e02044eed479f297ab3ce72e630edfea692831bf28e5bd5cbbef not found: ID does not exist" Jun 03 13:50:04.651239 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.651237 2562 scope.go:117] "RemoveContainer" containerID="8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629" Jun 03 13:50:04.651459 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.651442 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629"} err="failed to get container status \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": rpc error: code = NotFound desc = could not find container \"8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629\": container with ID starting with 8ababdbf3f7b2ed93f54d2406083b3559ea0941d54306465ca3b1b822cf1b629 not found: ID does not exist" Jun 03 13:50:04.651459 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.651458 2562 scope.go:117] "RemoveContainer" containerID="5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f" Jun 03 13:50:04.651662 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.651634 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f"} err="failed to get container status \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": rpc error: code = NotFound desc = could not find container \"5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f\": container with ID starting with 5948d6d498d8cb451476efb7a20872bfa3e9f6ce8af78578ad11abef11024b7f not found: ID does not exist" Jun 03 13:50:04.713485 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713449 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-kube-rbac-proxy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713485 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713480 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-grpc-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713485 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713490 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config-out\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713500 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713511 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-metrics-client-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713521 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713532 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713541 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5xxc\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-kube-api-access-n5xxc\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713550 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-metrics-client-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713562 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-k8s-db\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713571 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-web-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713580 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713588 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713598 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713607 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713616 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e999bbb-70cb-43e1-a18a-6b81bfe79098-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713625 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e999bbb-70cb-43e1-a18a-6b81bfe79098-tls-assets\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.713720 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.713634 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e999bbb-70cb-43e1-a18a-6b81bfe79098-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:04.902272 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.902236 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:50:04.908959 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.908929 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:50:04.964913 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.964874 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:50:04.965296 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965278 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-thanos" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965297 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-thanos" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965319 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-web" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965327 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-web" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965342 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="config-reloader" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965350 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="config-reloader" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965362 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="prometheus" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965372 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="prometheus" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965386 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="thanos-sidecar" Jun 03 13:50:04.965394 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965394 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="thanos-sidecar" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965406 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965414 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965435 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="init-config-reloader" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965444 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="init-config-reloader" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965516 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-web" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965529 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965540 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="prometheus" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965550 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="config-reloader" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965561 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="thanos-sidecar" Jun 03 13:50:04.965807 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.965571 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" containerName="kube-rbac-proxy-thanos" Jun 03 13:50:04.971324 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.971302 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:04.978757 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.978740 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 13:50:04.978914 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.978897 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rjh89\"" Jun 03 13:50:04.979056 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.979039 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 13:50:04.979269 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.979254 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 13:50:04.979421 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.979406 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 13:50:04.981905 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.981879 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 13:50:04.982009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.981990 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 13:50:04.982517 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.982500 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 13:50:04.982569 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.982551 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 13:50:04.982619 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.982583 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 13:50:04.982670 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.982624 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c72orgbv9p8mg\"" Jun 03 13:50:04.982975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.982962 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 13:50:04.984990 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.984971 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 13:50:04.988287 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:04.988271 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 13:50:05.015567 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.015567 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.015726 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.015726 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kf7p\" (UniqueName: \"kubernetes.io/projected/98bbbfef-45ed-49ed-8d2d-7be2334b654b-kube-api-access-6kf7p\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.015823 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.015929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.015929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.015929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016057 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016057 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.015993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-web-config\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016057 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016205 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016205 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016205 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-config\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016375 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016375 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016375 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98bbbfef-45ed-49ed-8d2d-7be2334b654b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.016375 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.016358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98bbbfef-45ed-49ed-8d2d-7be2334b654b-config-out\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.023160 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.023135 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:50:05.117052 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117010 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kf7p\" (UniqueName: \"kubernetes.io/projected/98bbbfef-45ed-49ed-8d2d-7be2334b654b-kube-api-access-6kf7p\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117068 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117088 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117108 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117128 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117147 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117166 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-web-config\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117199 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117253 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117248 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.117662 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117608 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117797 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117842 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-config\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117876 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117916 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117949 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98bbbfef-45ed-49ed-8d2d-7be2334b654b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.117977 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98bbbfef-45ed-49ed-8d2d-7be2334b654b-config-out\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.118008 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.118034 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.118047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.118071 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.118124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.118894 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.118797 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.119785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.119436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.120490 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.120466 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.120653 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.120466 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.121122 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.121081 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.121451 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.121426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98bbbfef-45ed-49ed-8d2d-7be2334b654b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.121581 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.121559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-web-config\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.122161 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.122132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-config\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.122361 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.122332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.122541 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.122522 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.122658 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.122640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.122725 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.122703 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98bbbfef-45ed-49ed-8d2d-7be2334b654b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.123347 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.123329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98bbbfef-45ed-49ed-8d2d-7be2334b654b-config-out\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.123605 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.123589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98bbbfef-45ed-49ed-8d2d-7be2334b654b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.130968 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.130919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kf7p\" (UniqueName: \"kubernetes.io/projected/98bbbfef-45ed-49ed-8d2d-7be2334b654b-kube-api-access-6kf7p\") pod \"prometheus-k8s-0\" (UID: \"98bbbfef-45ed-49ed-8d2d-7be2334b654b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.280632 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.280591 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:05.431445 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.431370 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:50:05.433455 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:50:05.433429 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bbbfef_45ed_49ed_8d2d_7be2334b654b.slice/crio-90b3ddd433413ea50d5f8bdff4f8f2a8dd0f226b196a69886429e2b576915c6f WatchSource:0}: Error finding container 90b3ddd433413ea50d5f8bdff4f8f2a8dd0f226b196a69886429e2b576915c6f: Status 404 returned error can't find the container with id 90b3ddd433413ea50d5f8bdff4f8f2a8dd0f226b196a69886429e2b576915c6f Jun 03 13:50:05.577184 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.577142 2562 generic.go:358] "Generic (PLEG): container finished" podID="98bbbfef-45ed-49ed-8d2d-7be2334b654b" containerID="9ecc536cada6a9e5341c195d89747e59199badaf3573b7faa4ca65458d052a21" exitCode=0 Jun 03 13:50:05.577605 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.577240 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerDied","Data":"9ecc536cada6a9e5341c195d89747e59199badaf3573b7faa4ca65458d052a21"} Jun 03 13:50:05.577605 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:05.577282 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerStarted","Data":"90b3ddd433413ea50d5f8bdff4f8f2a8dd0f226b196a69886429e2b576915c6f"} Jun 03 13:50:06.000286 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.000249 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e999bbb-70cb-43e1-a18a-6b81bfe79098" path="/var/lib/kubelet/pods/5e999bbb-70cb-43e1-a18a-6b81bfe79098/volumes" Jun 03 13:50:06.586179 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.586142 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerStarted","Data":"a0c91ea6a8a21588e6f1e5d961dc8e72b9e3704ed6a654a09f249cf354b93e90"} Jun 03 13:50:06.586179 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.586180 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerStarted","Data":"526d5540828612f2ad94f58cdc4d5602cad8bbca5c5644175c14d3e8d47282d8"} Jun 03 13:50:06.586649 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.586190 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerStarted","Data":"c76b6fa35bf84312e06809dc4357a607aff5d016e5e0c35a5063200089c6fbbd"} Jun 03 13:50:06.586649 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.586199 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerStarted","Data":"2131803901c12c3c2e0b3f2975360143e12875cfcb9b85eec0390d03e992e471"} Jun 03 13:50:06.586649 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.586207 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerStarted","Data":"5a6343a4123ddfd78cefe84cb76d1ae164b64c516343133e3bc82190eeaf0deb"} Jun 03 13:50:06.586649 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.586215 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98bbbfef-45ed-49ed-8d2d-7be2334b654b","Type":"ContainerStarted","Data":"c04ed9f988a3645a342de03cc1a6b499df134b638b77b984c558a514b6c080eb"} Jun 03 13:50:06.615402 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:06.615340 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6153179509999998 podStartE2EDuration="2.615317951s" podCreationTimestamp="2026-06-03 13:50:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:50:06.613331431 +0000 UTC m=+149.225736756" watchObservedRunningTime="2026-06-03 13:50:06.615317951 +0000 UTC m=+149.227723268" Jun 03 13:50:07.591406 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:07.591358 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" event={"ID":"8c98603e-f86a-4df9-b35b-b0f6524933db","Type":"ContainerStarted","Data":"63d658dbba12436441145853ec550a6a2281584b18fe60b0d18e399bcecf6b7e"} Jun 03 13:50:07.591406 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:07.591408 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" event={"ID":"8c98603e-f86a-4df9-b35b-b0f6524933db","Type":"ContainerStarted","Data":"ff9926b9a79888c9b9577f115f6a946f452c0bd7ecdf605a97897ea71fd86961"} Jun 03 13:50:07.591929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:07.591423 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" event={"ID":"8c98603e-f86a-4df9-b35b-b0f6524933db","Type":"ContainerStarted","Data":"78acb5b71f56600f78e793899ce073ef7c72b9255fd0da0131ae783b2ce97a76"} Jun 03 13:50:07.619822 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:07.619766 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f97b45f58-b6jfg" podStartSLOduration=2.196686686 podStartE2EDuration="4.619749083s" podCreationTimestamp="2026-06-03 13:50:03 +0000 UTC" firstStartedPulling="2026-06-03 13:50:04.403067798 +0000 UTC m=+147.015473092" lastFinishedPulling="2026-06-03 13:50:06.826130195 +0000 UTC m=+149.438535489" observedRunningTime="2026-06-03 13:50:07.616953761 +0000 UTC m=+150.229359077" watchObservedRunningTime="2026-06-03 13:50:07.619749083 +0000 UTC m=+150.232154399" Jun 03 13:50:08.304372 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.304339 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-67bc7dc9f7-nkblw"] Jun 03 13:50:08.307747 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.307725 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.322375 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.322346 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bc7dc9f7-nkblw"] Jun 03 13:50:08.346738 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.346701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-service-ca\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.346888 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.346753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-config\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.346888 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.346829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-trusted-ca-bundle\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.346888 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.346864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-serving-cert\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.347009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.346914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-oauth-config\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.347009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.346954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-oauth-serving-cert\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.347009 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.346977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg945\" (UniqueName: \"kubernetes.io/projected/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-kube-api-access-rg945\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.447485 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.447449 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-config\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.447485 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.447491 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-trusted-ca-bundle\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.447755 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.447520 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-serving-cert\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.447755 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.447560 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-oauth-config\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.447755 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.447611 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-oauth-serving-cert\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.447755 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.447643 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rg945\" (UniqueName: \"kubernetes.io/projected/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-kube-api-access-rg945\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.448682 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.447700 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-service-ca\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.448682 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.448258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-config\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.448682 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.448422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-oauth-serving-cert\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.448682 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.448641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-service-ca\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.449283 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.449263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-trusted-ca-bundle\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.449965 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.449946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-serving-cert\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.450155 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.450140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-oauth-config\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.456577 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.456555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg945\" (UniqueName: \"kubernetes.io/projected/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-kube-api-access-rg945\") pod \"console-67bc7dc9f7-nkblw\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.616461 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.616362 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:08.753389 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:08.753354 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bc7dc9f7-nkblw"] Jun 03 13:50:08.756467 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:50:08.756435 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0f6aa3_2673_42ab_90e6_1fbfbe53b1d5.slice/crio-fd5ef5fb8e51b0cc3009a1383f8355e564c3879e0ed26bb6a5dd01f1c6da1953 WatchSource:0}: Error finding container fd5ef5fb8e51b0cc3009a1383f8355e564c3879e0ed26bb6a5dd01f1c6da1953: Status 404 returned error can't find the container with id fd5ef5fb8e51b0cc3009a1383f8355e564c3879e0ed26bb6a5dd01f1c6da1953 Jun 03 13:50:09.599559 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:09.599523 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc7dc9f7-nkblw" event={"ID":"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5","Type":"ContainerStarted","Data":"4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361"} Jun 03 13:50:09.599559 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:09.599561 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc7dc9f7-nkblw" event={"ID":"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5","Type":"ContainerStarted","Data":"fd5ef5fb8e51b0cc3009a1383f8355e564c3879e0ed26bb6a5dd01f1c6da1953"} Jun 03 13:50:09.621057 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:09.620994 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-67bc7dc9f7-nkblw" podStartSLOduration=1.620976154 podStartE2EDuration="1.620976154s" podCreationTimestamp="2026-06-03 13:50:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:50:09.620155261 +0000 UTC m=+152.232560568" watchObservedRunningTime="2026-06-03 13:50:09.620976154 +0000 UTC m=+152.233381472" Jun 03 13:50:10.280892 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:10.280859 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:50:18.616979 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:18.616941 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:18.617445 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:18.616994 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:18.621814 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:18.621789 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:18.631646 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:18.631626 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:50:18.713992 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:18.713953 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b56fd745-9qzkk"] Jun 03 13:50:43.734231 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.734167 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-66b56fd745-9qzkk" podUID="52405641-2d4d-4781-bc5f-06c553df68fb" containerName="console" containerID="cri-o://beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4" gracePeriod=15 Jun 03 13:50:43.969755 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.969728 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66b56fd745-9qzkk_52405641-2d4d-4781-bc5f-06c553df68fb/console/0.log" Jun 03 13:50:43.969877 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.969793 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:50:43.976310 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976281 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-service-ca\") pod \"52405641-2d4d-4781-bc5f-06c553df68fb\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " Jun 03 13:50:43.976468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976318 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84rqq\" (UniqueName: \"kubernetes.io/projected/52405641-2d4d-4781-bc5f-06c553df68fb-kube-api-access-84rqq\") pod \"52405641-2d4d-4781-bc5f-06c553df68fb\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " Jun 03 13:50:43.976468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976336 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-serving-cert\") pod \"52405641-2d4d-4781-bc5f-06c553df68fb\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " Jun 03 13:50:43.976468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976375 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-trusted-ca-bundle\") pod \"52405641-2d4d-4781-bc5f-06c553df68fb\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " Jun 03 13:50:43.976468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976392 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-oauth-serving-cert\") pod \"52405641-2d4d-4781-bc5f-06c553df68fb\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " Jun 03 13:50:43.976468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976416 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-console-config\") pod \"52405641-2d4d-4781-bc5f-06c553df68fb\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " Jun 03 13:50:43.976468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976443 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-oauth-config\") pod \"52405641-2d4d-4781-bc5f-06c553df68fb\" (UID: \"52405641-2d4d-4781-bc5f-06c553df68fb\") " Jun 03 13:50:43.976816 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976677 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "52405641-2d4d-4781-bc5f-06c553df68fb" (UID: "52405641-2d4d-4781-bc5f-06c553df68fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:43.976914 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976875 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-console-config" (OuterVolumeSpecName: "console-config") pod "52405641-2d4d-4781-bc5f-06c553df68fb" (UID: "52405641-2d4d-4781-bc5f-06c553df68fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:43.976914 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976909 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "52405641-2d4d-4781-bc5f-06c553df68fb" (UID: "52405641-2d4d-4781-bc5f-06c553df68fb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:43.977089 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.976960 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "52405641-2d4d-4781-bc5f-06c553df68fb" (UID: "52405641-2d4d-4781-bc5f-06c553df68fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:50:43.978523 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.978496 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52405641-2d4d-4781-bc5f-06c553df68fb-kube-api-access-84rqq" (OuterVolumeSpecName: "kube-api-access-84rqq") pod "52405641-2d4d-4781-bc5f-06c553df68fb" (UID: "52405641-2d4d-4781-bc5f-06c553df68fb"). InnerVolumeSpecName "kube-api-access-84rqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:50:43.978608 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.978540 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "52405641-2d4d-4781-bc5f-06c553df68fb" (UID: "52405641-2d4d-4781-bc5f-06c553df68fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:43.978734 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:43.978713 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "52405641-2d4d-4781-bc5f-06c553df68fb" (UID: "52405641-2d4d-4781-bc5f-06c553df68fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:50:44.077556 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.077517 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:44.077556 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.077552 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84rqq\" (UniqueName: \"kubernetes.io/projected/52405641-2d4d-4781-bc5f-06c553df68fb-kube-api-access-84rqq\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:44.077556 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.077564 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:44.077793 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.077573 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-trusted-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:44.077793 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.077583 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-oauth-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:44.077793 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.077592 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52405641-2d4d-4781-bc5f-06c553df68fb-console-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:44.077793 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.077600 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52405641-2d4d-4781-bc5f-06c553df68fb-console-oauth-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:50:44.705786 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.705760 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66b56fd745-9qzkk_52405641-2d4d-4781-bc5f-06c553df68fb/console/0.log" Jun 03 13:50:44.705961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.705797 2562 generic.go:358] "Generic (PLEG): container finished" podID="52405641-2d4d-4781-bc5f-06c553df68fb" containerID="beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4" exitCode=2 Jun 03 13:50:44.705961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.705863 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56fd745-9qzkk" Jun 03 13:50:44.705961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.705867 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56fd745-9qzkk" event={"ID":"52405641-2d4d-4781-bc5f-06c553df68fb","Type":"ContainerDied","Data":"beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4"} Jun 03 13:50:44.705961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.705901 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56fd745-9qzkk" event={"ID":"52405641-2d4d-4781-bc5f-06c553df68fb","Type":"ContainerDied","Data":"d83b481db841f4737d6d96b891e8cc3a10000c1a5593a281b2060936adea9275"} Jun 03 13:50:44.705961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.705920 2562 scope.go:117] "RemoveContainer" containerID="beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4" Jun 03 13:50:44.718851 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.718829 2562 scope.go:117] "RemoveContainer" containerID="beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4" Jun 03 13:50:44.719089 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:50:44.719071 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4\": container with ID starting with beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4 not found: ID does not exist" containerID="beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4" Jun 03 13:50:44.719140 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.719098 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4"} err="failed to get container status \"beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4\": rpc error: code = NotFound desc = could not find container \"beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4\": container with ID starting with beabc11a6745119fb12647c58a90a7c40d893b7023ffe853cafaa38f0b9927d4 not found: ID does not exist" Jun 03 13:50:44.731146 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.731108 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b56fd745-9qzkk"] Jun 03 13:50:44.736543 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:44.736517 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66b56fd745-9qzkk"] Jun 03 13:50:45.998975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:50:45.998941 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52405641-2d4d-4781-bc5f-06c553df68fb" path="/var/lib/kubelet/pods/52405641-2d4d-4781-bc5f-06c553df68fb/volumes" Jun 03 13:51:05.280946 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:05.280902 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:51:05.296829 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:05.296799 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:51:05.781726 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:05.781700 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:51:24.958187 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:24.958150 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-86698bcc4d-nl6vr"] Jun 03 13:51:24.958690 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:24.958488 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52405641-2d4d-4781-bc5f-06c553df68fb" containerName="console" Jun 03 13:51:24.958690 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:24.958500 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52405641-2d4d-4781-bc5f-06c553df68fb" containerName="console" Jun 03 13:51:24.958690 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:24.958562 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="52405641-2d4d-4781-bc5f-06c553df68fb" containerName="console" Jun 03 13:51:24.961433 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:24.961415 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:24.979573 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:24.979549 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86698bcc4d-nl6vr"] Jun 03 13:51:25.047749 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.047712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-oauth-serving-cert\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.047749 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.047757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztqw8\" (UniqueName: \"kubernetes.io/projected/deb50de5-5f8c-4489-8f4c-199feb9edc8c-kube-api-access-ztqw8\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.047969 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.047778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-service-ca\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.047969 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.047872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-oauth-config\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.047969 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.047902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-config\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.047969 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.047939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-serving-cert\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.048111 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.047984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-trusted-ca-bundle\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.148552 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.148519 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-serving-cert\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.148552 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.148555 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-trusted-ca-bundle\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.148787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.148598 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-oauth-serving-cert\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.148787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.148621 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztqw8\" (UniqueName: \"kubernetes.io/projected/deb50de5-5f8c-4489-8f4c-199feb9edc8c-kube-api-access-ztqw8\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.148787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.148646 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-service-ca\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.148787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.148708 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-oauth-config\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.148787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.148727 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-config\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.149571 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.149544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-oauth-serving-cert\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.149758 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.149698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-config\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.149884 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.149862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-trusted-ca-bundle\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.149925 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.149862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-service-ca\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.150912 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.150891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-serving-cert\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.151074 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.151052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-oauth-config\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.157382 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.157356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztqw8\" (UniqueName: \"kubernetes.io/projected/deb50de5-5f8c-4489-8f4c-199feb9edc8c-kube-api-access-ztqw8\") pod \"console-86698bcc4d-nl6vr\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.271150 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.271063 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:25.407788 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.407756 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86698bcc4d-nl6vr"] Jun 03 13:51:25.410784 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:51:25.410758 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb50de5_5f8c_4489_8f4c_199feb9edc8c.slice/crio-e631723cba63dbfbf0e44e2981eecdc93958fa5e8b7da7a9f6a0d9775c785c09 WatchSource:0}: Error finding container e631723cba63dbfbf0e44e2981eecdc93958fa5e8b7da7a9f6a0d9775c785c09: Status 404 returned error can't find the container with id e631723cba63dbfbf0e44e2981eecdc93958fa5e8b7da7a9f6a0d9775c785c09 Jun 03 13:51:25.828961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.828925 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86698bcc4d-nl6vr" event={"ID":"deb50de5-5f8c-4489-8f4c-199feb9edc8c","Type":"ContainerStarted","Data":"79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49"} Jun 03 13:51:25.828961 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.828962 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86698bcc4d-nl6vr" event={"ID":"deb50de5-5f8c-4489-8f4c-199feb9edc8c","Type":"ContainerStarted","Data":"e631723cba63dbfbf0e44e2981eecdc93958fa5e8b7da7a9f6a0d9775c785c09"} Jun 03 13:51:25.848498 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:25.848447 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-86698bcc4d-nl6vr" podStartSLOduration=1.848433216 podStartE2EDuration="1.848433216s" podCreationTimestamp="2026-06-03 13:51:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:51:25.846127915 +0000 UTC m=+228.458533231" watchObservedRunningTime="2026-06-03 13:51:25.848433216 +0000 UTC m=+228.460838532" Jun 03 13:51:35.271867 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:35.271829 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:35.271867 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:35.271873 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:35.276746 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:35.276726 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:35.869975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:35.869944 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 13:51:35.917045 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:35.917009 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bc7dc9f7-nkblw"] Jun 03 13:51:53.112916 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.112884 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8mb6n"] Jun 03 13:51:53.117281 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.117263 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.125747 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.125728 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 13:51:53.135785 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.135763 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mb6n"] Jun 03 13:51:53.197636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.197600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c48c289d-5be8-4f5f-8c72-7b1677abe972-kubelet-config\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.197813 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.197677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c48c289d-5be8-4f5f-8c72-7b1677abe972-dbus\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.197813 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.197712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c48c289d-5be8-4f5f-8c72-7b1677abe972-original-pull-secret\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.298833 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.298801 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c48c289d-5be8-4f5f-8c72-7b1677abe972-kubelet-config\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.299005 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.298868 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c48c289d-5be8-4f5f-8c72-7b1677abe972-dbus\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.299005 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.298906 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c48c289d-5be8-4f5f-8c72-7b1677abe972-original-pull-secret\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.299005 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.298932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c48c289d-5be8-4f5f-8c72-7b1677abe972-kubelet-config\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.299109 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.299083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c48c289d-5be8-4f5f-8c72-7b1677abe972-dbus\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.301264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.301243 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c48c289d-5be8-4f5f-8c72-7b1677abe972-original-pull-secret\") pod \"global-pull-secret-syncer-8mb6n\" (UID: \"c48c289d-5be8-4f5f-8c72-7b1677abe972\") " pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.425760 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.425733 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mb6n" Jun 03 13:51:53.555092 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.555056 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mb6n"] Jun 03 13:51:53.555239 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:51:53.555162 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48c289d_5be8_4f5f_8c72_7b1677abe972.slice/crio-33bde002aa1ac1a624863e0f6f372a6819ae569f46c71769ce07a7dd1e18ca69 WatchSource:0}: Error finding container 33bde002aa1ac1a624863e0f6f372a6819ae569f46c71769ce07a7dd1e18ca69: Status 404 returned error can't find the container with id 33bde002aa1ac1a624863e0f6f372a6819ae569f46c71769ce07a7dd1e18ca69 Jun 03 13:51:53.919571 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:53.919539 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mb6n" event={"ID":"c48c289d-5be8-4f5f-8c72-7b1677abe972","Type":"ContainerStarted","Data":"33bde002aa1ac1a624863e0f6f372a6819ae569f46c71769ce07a7dd1e18ca69"} Jun 03 13:51:57.932401 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:57.932358 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mb6n" event={"ID":"c48c289d-5be8-4f5f-8c72-7b1677abe972","Type":"ContainerStarted","Data":"9a294f260a3668409898c0ec364e1b5da381136f545b4e28f26e3f2acf3e72d3"} Jun 03 13:51:57.947129 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:51:57.946924 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8mb6n" podStartSLOduration=0.71460872 podStartE2EDuration="4.946905911s" podCreationTimestamp="2026-06-03 13:51:53 +0000 UTC" firstStartedPulling="2026-06-03 13:51:53.556819499 +0000 UTC m=+256.169224794" lastFinishedPulling="2026-06-03 13:51:57.789116687 +0000 UTC m=+260.401521985" observedRunningTime="2026-06-03 13:51:57.94666041 +0000 UTC m=+260.559065726" watchObservedRunningTime="2026-06-03 13:51:57.946905911 +0000 UTC m=+260.559311224" Jun 03 13:52:00.937637 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:00.937570 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-67bc7dc9f7-nkblw" podUID="1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" containerName="console" containerID="cri-o://4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361" gracePeriod=15 Jun 03 13:52:01.185039 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.185016 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67bc7dc9f7-nkblw_1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5/console/0.log" Jun 03 13:52:01.185179 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.185076 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:52:01.276942 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.276848 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-oauth-config\") pod \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " Jun 03 13:52:01.276942 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.276902 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-service-ca\") pod \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " Jun 03 13:52:01.276942 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.276926 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-serving-cert\") pod \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " Jun 03 13:52:01.277331 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.276948 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-trusted-ca-bundle\") pod \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " Jun 03 13:52:01.277331 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.277003 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg945\" (UniqueName: \"kubernetes.io/projected/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-kube-api-access-rg945\") pod \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " Jun 03 13:52:01.277331 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.277031 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-config\") pod \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " Jun 03 13:52:01.277331 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.277079 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-oauth-serving-cert\") pod \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\" (UID: \"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5\") " Jun 03 13:52:01.277331 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.277310 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" (UID: "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:52:01.277580 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.277550 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" (UID: "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:52:01.277636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.277554 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" (UID: "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:52:01.277687 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.277663 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-config" (OuterVolumeSpecName: "console-config") pod "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" (UID: "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:52:01.279325 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.279296 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" (UID: "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:52:01.279435 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.279343 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-kube-api-access-rg945" (OuterVolumeSpecName: "kube-api-access-rg945") pod "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" (UID: "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5"). InnerVolumeSpecName "kube-api-access-rg945". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:52:01.279435 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.279370 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" (UID: "1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:52:01.377787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.377733 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-oauth-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:52:01.377787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.377779 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-oauth-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:52:01.377787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.377790 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:52:01.377787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.377800 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:52:01.377787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.377808 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-trusted-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:52:01.378081 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.377818 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg945\" (UniqueName: \"kubernetes.io/projected/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-kube-api-access-rg945\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:52:01.378081 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.377826 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5-console-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:52:01.943985 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.943959 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67bc7dc9f7-nkblw_1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5/console/0.log" Jun 03 13:52:01.944405 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.944002 2562 generic.go:358] "Generic (PLEG): container finished" podID="1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" containerID="4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361" exitCode=2 Jun 03 13:52:01.944405 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.944037 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc7dc9f7-nkblw" event={"ID":"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5","Type":"ContainerDied","Data":"4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361"} Jun 03 13:52:01.944405 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.944070 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc7dc9f7-nkblw" Jun 03 13:52:01.944405 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.944080 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc7dc9f7-nkblw" event={"ID":"1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5","Type":"ContainerDied","Data":"fd5ef5fb8e51b0cc3009a1383f8355e564c3879e0ed26bb6a5dd01f1c6da1953"} Jun 03 13:52:01.944405 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.944099 2562 scope.go:117] "RemoveContainer" containerID="4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361" Jun 03 13:52:01.953355 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.953278 2562 scope.go:117] "RemoveContainer" containerID="4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361" Jun 03 13:52:01.953672 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:52:01.953609 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361\": container with ID starting with 4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361 not found: ID does not exist" containerID="4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361" Jun 03 13:52:01.953672 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.953642 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361"} err="failed to get container status \"4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361\": rpc error: code = NotFound desc = could not find container \"4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361\": container with ID starting with 4e46ccc52866b319ab7e75f869652cd2a38e52e2dd104d34207dfd0fbff6c361 not found: ID does not exist" Jun 03 13:52:01.965929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.965899 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bc7dc9f7-nkblw"] Jun 03 13:52:01.971696 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.971668 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67bc7dc9f7-nkblw"] Jun 03 13:52:01.998166 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:01.998139 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" path="/var/lib/kubelet/pods/1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5/volumes" Jun 03 13:52:37.893824 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:52:37.893796 2562 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 13:53:14.393034 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.393000 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk"] Jun 03 13:53:14.394410 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.393351 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" containerName="console" Jun 03 13:53:14.394410 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.393363 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" containerName="console" Jun 03 13:53:14.394410 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.393432 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c0f6aa3-2673-42ab-90e6-1fbfbe53b1d5" containerName="console" Jun 03 13:53:14.394988 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.394973 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.397370 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.397347 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:53:14.397493 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.397346 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sx9w9\"" Jun 03 13:53:14.398317 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.398302 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 13:53:14.404928 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.404895 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk"] Jun 03 13:53:14.469536 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.469496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf8e7e19-8a9c-448a-987d-f6202423432b-tmp\") pod \"openshift-lws-operator-bfc7f696d-c29pk\" (UID: \"bf8e7e19-8a9c-448a-987d-f6202423432b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.469728 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.469570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl25x\" (UniqueName: \"kubernetes.io/projected/bf8e7e19-8a9c-448a-987d-f6202423432b-kube-api-access-dl25x\") pod \"openshift-lws-operator-bfc7f696d-c29pk\" (UID: \"bf8e7e19-8a9c-448a-987d-f6202423432b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.570096 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.570056 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf8e7e19-8a9c-448a-987d-f6202423432b-tmp\") pod \"openshift-lws-operator-bfc7f696d-c29pk\" (UID: \"bf8e7e19-8a9c-448a-987d-f6202423432b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.570299 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.570132 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dl25x\" (UniqueName: \"kubernetes.io/projected/bf8e7e19-8a9c-448a-987d-f6202423432b-kube-api-access-dl25x\") pod \"openshift-lws-operator-bfc7f696d-c29pk\" (UID: \"bf8e7e19-8a9c-448a-987d-f6202423432b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.570485 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.570464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf8e7e19-8a9c-448a-987d-f6202423432b-tmp\") pod \"openshift-lws-operator-bfc7f696d-c29pk\" (UID: \"bf8e7e19-8a9c-448a-987d-f6202423432b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.578005 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.577974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl25x\" (UniqueName: \"kubernetes.io/projected/bf8e7e19-8a9c-448a-987d-f6202423432b-kube-api-access-dl25x\") pod \"openshift-lws-operator-bfc7f696d-c29pk\" (UID: \"bf8e7e19-8a9c-448a-987d-f6202423432b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.718243 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.718187 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" Jun 03 13:53:14.863716 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.863685 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk"] Jun 03 13:53:14.867351 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:53:14.867320 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf8e7e19_8a9c_448a_987d_f6202423432b.slice/crio-bc1d6fc01b95b8ac2682526fb32ec2d7fcb57da76bf4582aeaa6b85f0c540fac WatchSource:0}: Error finding container bc1d6fc01b95b8ac2682526fb32ec2d7fcb57da76bf4582aeaa6b85f0c540fac: Status 404 returned error can't find the container with id bc1d6fc01b95b8ac2682526fb32ec2d7fcb57da76bf4582aeaa6b85f0c540fac Jun 03 13:53:14.868850 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:14.868828 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 13:53:15.151586 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:15.151504 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" event={"ID":"bf8e7e19-8a9c-448a-987d-f6202423432b","Type":"ContainerStarted","Data":"bc1d6fc01b95b8ac2682526fb32ec2d7fcb57da76bf4582aeaa6b85f0c540fac"} Jun 03 13:53:18.162003 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:18.161967 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" event={"ID":"bf8e7e19-8a9c-448a-987d-f6202423432b","Type":"ContainerStarted","Data":"40171bf962a5d8f43931fcd8b5f7fb698a0a93603b5c76f52f536943d303fdb0"} Jun 03 13:53:18.178859 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:18.178809 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-c29pk" podStartSLOduration=1.509805166 podStartE2EDuration="4.178794476s" podCreationTimestamp="2026-06-03 13:53:14 +0000 UTC" firstStartedPulling="2026-06-03 13:53:14.868987203 +0000 UTC m=+337.481392497" lastFinishedPulling="2026-06-03 13:53:17.537976512 +0000 UTC m=+340.150381807" observedRunningTime="2026-06-03 13:53:18.177399671 +0000 UTC m=+340.789804988" watchObservedRunningTime="2026-06-03 13:53:18.178794476 +0000 UTC m=+340.791199791" Jun 03 13:53:33.606680 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.606601 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp"] Jun 03 13:53:33.610133 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.610113 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.616468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.616429 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 13:53:33.616468 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.616448 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 13:53:33.616750 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.616732 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 13:53:33.617163 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.617146 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-trdzv\"" Jun 03 13:53:33.617275 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.617251 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 13:53:33.646090 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.646060 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp"] Jun 03 13:53:33.745149 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.745111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-tmp\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.745149 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.745150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7q5\" (UniqueName: \"kubernetes.io/projected/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-kube-api-access-5t7q5\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.745400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.745179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.745400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.745273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.745400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.745349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-manifests\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.846312 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.846271 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-manifests\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.846498 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.846349 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-tmp\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.846498 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.846370 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7q5\" (UniqueName: \"kubernetes.io/projected/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-kube-api-access-5t7q5\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.846498 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.846400 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.846498 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.846427 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.846749 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.846723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-manifests\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.848691 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.848668 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-tmp\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.848787 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.848768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.848891 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.848875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.871337 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.871273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7q5\" (UniqueName: \"kubernetes.io/projected/d5e27e2e-4ff1-44bd-a9c6-ebce2054749e-kube-api-access-5t7q5\") pod \"opendatahub-operator-controller-manager-5496d4666c-glwjp\" (UID: \"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e\") " pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:33.920073 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:33.920044 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:34.092088 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:34.092050 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp"] Jun 03 13:53:34.096243 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:53:34.096196 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e27e2e_4ff1_44bd_a9c6_ebce2054749e.slice/crio-83231116cb9a99a89277a07e7f21da9aaab03d1ff474b189e0cce42c300a77ba WatchSource:0}: Error finding container 83231116cb9a99a89277a07e7f21da9aaab03d1ff474b189e0cce42c300a77ba: Status 404 returned error can't find the container with id 83231116cb9a99a89277a07e7f21da9aaab03d1ff474b189e0cce42c300a77ba Jun 03 13:53:34.210990 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:34.210957 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" event={"ID":"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e","Type":"ContainerStarted","Data":"83231116cb9a99a89277a07e7f21da9aaab03d1ff474b189e0cce42c300a77ba"} Jun 03 13:53:37.222044 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:37.221949 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" event={"ID":"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e","Type":"ContainerStarted","Data":"888fe2739f123341b3fedc90eb851701c3a890a95fb484a7f405af8f63f60c49"} Jun 03 13:53:38.226659 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:38.226563 2562 generic.go:358] "Generic (PLEG): container finished" podID="d5e27e2e-4ff1-44bd-a9c6-ebce2054749e" containerID="888fe2739f123341b3fedc90eb851701c3a890a95fb484a7f405af8f63f60c49" exitCode=0 Jun 03 13:53:38.226659 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:38.226601 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" event={"ID":"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e","Type":"ContainerDied","Data":"888fe2739f123341b3fedc90eb851701c3a890a95fb484a7f405af8f63f60c49"} Jun 03 13:53:39.231808 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:39.231760 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" event={"ID":"d5e27e2e-4ff1-44bd-a9c6-ebce2054749e","Type":"ContainerStarted","Data":"7f49ed5703464fc60a622e3bfbc89cff8b2c29028c13eb8642709a4aeb2179a3"} Jun 03 13:53:39.232318 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:39.231896 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:39.279094 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:39.279040 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" podStartSLOduration=1.7103926170000001 podStartE2EDuration="6.279026821s" podCreationTimestamp="2026-06-03 13:53:33 +0000 UTC" firstStartedPulling="2026-06-03 13:53:34.098072842 +0000 UTC m=+356.710478140" lastFinishedPulling="2026-06-03 13:53:38.666707048 +0000 UTC m=+361.279112344" observedRunningTime="2026-06-03 13:53:39.278534151 +0000 UTC m=+361.890939467" watchObservedRunningTime="2026-06-03 13:53:39.279026821 +0000 UTC m=+361.891432134" Jun 03 13:53:50.237890 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.237850 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5496d4666c-glwjp" Jun 03 13:53:50.628550 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.628470 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8"] Jun 03 13:53:50.638005 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.637969 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.643179 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.643150 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 13:53:50.644050 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.643896 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 13:53:50.644249 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.644120 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 13:53:50.644346 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.644258 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tc7wg\"" Jun 03 13:53:50.659215 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.659183 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8"] Jun 03 13:53:50.712649 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.712611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7447ad98-8786-4d2f-924c-939b03b0119e-cert\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.712649 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.712650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7447ad98-8786-4d2f-924c-939b03b0119e-manager-config\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.712872 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.712690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mg4f\" (UniqueName: \"kubernetes.io/projected/7447ad98-8786-4d2f-924c-939b03b0119e-kube-api-access-5mg4f\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.712872 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.712752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7447ad98-8786-4d2f-924c-939b03b0119e-metrics-cert\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.813192 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.813158 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7447ad98-8786-4d2f-924c-939b03b0119e-cert\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.813390 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.813197 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7447ad98-8786-4d2f-924c-939b03b0119e-manager-config\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.813390 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.813277 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mg4f\" (UniqueName: \"kubernetes.io/projected/7447ad98-8786-4d2f-924c-939b03b0119e-kube-api-access-5mg4f\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.813390 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.813323 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7447ad98-8786-4d2f-924c-939b03b0119e-metrics-cert\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.813931 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.813912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7447ad98-8786-4d2f-924c-939b03b0119e-manager-config\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.815665 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.815643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7447ad98-8786-4d2f-924c-939b03b0119e-metrics-cert\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.815793 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.815776 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7447ad98-8786-4d2f-924c-939b03b0119e-cert\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.844305 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.844278 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mg4f\" (UniqueName: \"kubernetes.io/projected/7447ad98-8786-4d2f-924c-939b03b0119e-kube-api-access-5mg4f\") pod \"lws-controller-manager-759cc9b955-d7hw8\" (UID: \"7447ad98-8786-4d2f-924c-939b03b0119e\") " pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:50.949410 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:50.949376 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:53:51.102449 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:51.102415 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8"] Jun 03 13:53:51.102603 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:53:51.102513 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7447ad98_8786_4d2f_924c_939b03b0119e.slice/crio-5c315c9afc41a5e56e95f5305a648b55f6dac62f05ff7e36a3901c95772e9e06 WatchSource:0}: Error finding container 5c315c9afc41a5e56e95f5305a648b55f6dac62f05ff7e36a3901c95772e9e06: Status 404 returned error can't find the container with id 5c315c9afc41a5e56e95f5305a648b55f6dac62f05ff7e36a3901c95772e9e06 Jun 03 13:53:51.275064 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:51.274977 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" event={"ID":"7447ad98-8786-4d2f-924c-939b03b0119e","Type":"ContainerStarted","Data":"5c315c9afc41a5e56e95f5305a648b55f6dac62f05ff7e36a3901c95772e9e06"} Jun 03 13:53:53.500499 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.500468 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4"] Jun 03 13:53:53.508459 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.508436 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.512572 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.512548 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 13:53:53.513723 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.513701 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 13:53:53.513846 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.513726 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kr2np\"" Jun 03 13:53:53.513846 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.513750 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 13:53:53.513846 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.513768 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 13:53:53.524133 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.524107 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4"] Jun 03 13:53:53.538058 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.538023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0919bc5-5232-41a5-9a96-c45a07e2b757-tmp\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.538182 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.538084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0919bc5-5232-41a5-9a96-c45a07e2b757-tls-certs\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.538182 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.538157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmm9\" (UniqueName: \"kubernetes.io/projected/c0919bc5-5232-41a5-9a96-c45a07e2b757-kube-api-access-hvmm9\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.639164 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.639107 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0919bc5-5232-41a5-9a96-c45a07e2b757-tmp\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.639392 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.639191 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0919bc5-5232-41a5-9a96-c45a07e2b757-tls-certs\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.639392 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.639281 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmm9\" (UniqueName: \"kubernetes.io/projected/c0919bc5-5232-41a5-9a96-c45a07e2b757-kube-api-access-hvmm9\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.641654 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.641624 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0919bc5-5232-41a5-9a96-c45a07e2b757-tmp\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.641865 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.641746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0919bc5-5232-41a5-9a96-c45a07e2b757-tls-certs\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.653374 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.653343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmm9\" (UniqueName: \"kubernetes.io/projected/c0919bc5-5232-41a5-9a96-c45a07e2b757-kube-api-access-hvmm9\") pod \"kube-auth-proxy-854c9b8647-gxsn4\" (UID: \"c0919bc5-5232-41a5-9a96-c45a07e2b757\") " pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:53.818643 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:53.818542 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" Jun 03 13:53:54.025451 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:54.025421 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4"] Jun 03 13:53:54.026475 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:53:54.026449 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0919bc5_5232_41a5_9a96_c45a07e2b757.slice/crio-8bae3dead2a0c97cbf743a15f2414c863bf69f82683660a2fdf9f386fc497f17 WatchSource:0}: Error finding container 8bae3dead2a0c97cbf743a15f2414c863bf69f82683660a2fdf9f386fc497f17: Status 404 returned error can't find the container with id 8bae3dead2a0c97cbf743a15f2414c863bf69f82683660a2fdf9f386fc497f17 Jun 03 13:53:54.287523 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:54.287488 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" event={"ID":"c0919bc5-5232-41a5-9a96-c45a07e2b757","Type":"ContainerStarted","Data":"8bae3dead2a0c97cbf743a15f2414c863bf69f82683660a2fdf9f386fc497f17"} Jun 03 13:53:57.301451 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:57.301362 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" event={"ID":"c0919bc5-5232-41a5-9a96-c45a07e2b757","Type":"ContainerStarted","Data":"8540ed8837b3fa12fc629dce51ee880f0fbf930e91819d9837251829947b8795"} Jun 03 13:53:57.327771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:53:57.327716 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-854c9b8647-gxsn4" podStartSLOduration=1.401240024 podStartE2EDuration="4.327701207s" podCreationTimestamp="2026-06-03 13:53:53 +0000 UTC" firstStartedPulling="2026-06-03 13:53:54.028437393 +0000 UTC m=+376.640842687" lastFinishedPulling="2026-06-03 13:53:56.954898565 +0000 UTC m=+379.567303870" observedRunningTime="2026-06-03 13:53:57.326412904 +0000 UTC m=+379.938818220" watchObservedRunningTime="2026-06-03 13:53:57.327701207 +0000 UTC m=+379.940106523" Jun 03 13:54:00.313391 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:00.313354 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" event={"ID":"7447ad98-8786-4d2f-924c-939b03b0119e","Type":"ContainerStarted","Data":"3a595a3d1d207c81e8a6d090c42f53c99d69707e2f9e90ea5434b6eafc07a80f"} Jun 03 13:54:00.313771 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:00.313576 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:54:00.333706 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:00.333662 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" podStartSLOduration=2.157050191 podStartE2EDuration="10.333647592s" podCreationTimestamp="2026-06-03 13:53:50 +0000 UTC" firstStartedPulling="2026-06-03 13:53:51.1042498 +0000 UTC m=+373.716655097" lastFinishedPulling="2026-06-03 13:53:59.2808472 +0000 UTC m=+381.893252498" observedRunningTime="2026-06-03 13:54:00.332607431 +0000 UTC m=+382.945012760" watchObservedRunningTime="2026-06-03 13:54:00.333647592 +0000 UTC m=+382.946052907" Jun 03 13:54:11.320247 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:11.320201 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-759cc9b955-d7hw8" Jun 03 13:54:54.477108 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.477031 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4qsnd"] Jun 03 13:54:54.481401 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.481384 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" Jun 03 13:54:54.485075 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.485053 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-245bf\"" Jun 03 13:54:54.485188 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.485147 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 13:54:54.485371 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.485358 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 13:54:54.495572 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.495545 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4qsnd"] Jun 03 13:54:54.585885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.585839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/b49398c0-721a-4c21-a116-3b886f86d72f-kube-api-access-5jmmc\") pod \"kuadrant-operator-catalog-4qsnd\" (UID: \"b49398c0-721a-4c21-a116-3b886f86d72f\") " pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" Jun 03 13:54:54.686948 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.686911 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/b49398c0-721a-4c21-a116-3b886f86d72f-kube-api-access-5jmmc\") pod \"kuadrant-operator-catalog-4qsnd\" (UID: \"b49398c0-721a-4c21-a116-3b886f86d72f\") " pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" Jun 03 13:54:54.699428 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.699395 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/b49398c0-721a-4c21-a116-3b886f86d72f-kube-api-access-5jmmc\") pod \"kuadrant-operator-catalog-4qsnd\" (UID: \"b49398c0-721a-4c21-a116-3b886f86d72f\") " pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" Jun 03 13:54:54.791718 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.791629 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" Jun 03 13:54:54.850076 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.848047 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4qsnd"] Jun 03 13:54:54.942689 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:54.942649 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4qsnd"] Jun 03 13:54:54.945924 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:54:54.945882 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49398c0_721a_4c21_a116_3b886f86d72f.slice/crio-7dee9dcefdda3a0dcf7a30b341a9a25ba25bdc4ac595b786e6d35d3315e02067 WatchSource:0}: Error finding container 7dee9dcefdda3a0dcf7a30b341a9a25ba25bdc4ac595b786e6d35d3315e02067: Status 404 returned error can't find the container with id 7dee9dcefdda3a0dcf7a30b341a9a25ba25bdc4ac595b786e6d35d3315e02067 Jun 03 13:54:55.510500 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:55.510465 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" event={"ID":"b49398c0-721a-4c21-a116-3b886f86d72f","Type":"ContainerStarted","Data":"7dee9dcefdda3a0dcf7a30b341a9a25ba25bdc4ac595b786e6d35d3315e02067"} Jun 03 13:54:57.518844 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:57.518798 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" event={"ID":"b49398c0-721a-4c21-a116-3b886f86d72f","Type":"ContainerStarted","Data":"88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4"} Jun 03 13:54:57.519322 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:57.518909 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" podUID="b49398c0-721a-4c21-a116-3b886f86d72f" containerName="registry-server" containerID="cri-o://88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4" gracePeriod=2 Jun 03 13:54:57.535706 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:57.535664 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" podStartSLOduration=1.490932518 podStartE2EDuration="3.535649198s" podCreationTimestamp="2026-06-03 13:54:54 +0000 UTC" firstStartedPulling="2026-06-03 13:54:54.947367899 +0000 UTC m=+437.559773193" lastFinishedPulling="2026-06-03 13:54:56.992084577 +0000 UTC m=+439.604489873" observedRunningTime="2026-06-03 13:54:57.53412109 +0000 UTC m=+440.146526405" watchObservedRunningTime="2026-06-03 13:54:57.535649198 +0000 UTC m=+440.148054514" Jun 03 13:54:57.757921 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:57.757897 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" Jun 03 13:54:57.817489 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:57.817407 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/b49398c0-721a-4c21-a116-3b886f86d72f-kube-api-access-5jmmc\") pod \"b49398c0-721a-4c21-a116-3b886f86d72f\" (UID: \"b49398c0-721a-4c21-a116-3b886f86d72f\") " Jun 03 13:54:57.819507 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:57.819469 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49398c0-721a-4c21-a116-3b886f86d72f-kube-api-access-5jmmc" (OuterVolumeSpecName: "kube-api-access-5jmmc") pod "b49398c0-721a-4c21-a116-3b886f86d72f" (UID: "b49398c0-721a-4c21-a116-3b886f86d72f"). InnerVolumeSpecName "kube-api-access-5jmmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:54:57.918770 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:57.918734 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/b49398c0-721a-4c21-a116-3b886f86d72f-kube-api-access-5jmmc\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:54:58.522796 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.522758 2562 generic.go:358] "Generic (PLEG): container finished" podID="b49398c0-721a-4c21-a116-3b886f86d72f" containerID="88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4" exitCode=0 Jun 03 13:54:58.523264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.522816 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" event={"ID":"b49398c0-721a-4c21-a116-3b886f86d72f","Type":"ContainerDied","Data":"88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4"} Jun 03 13:54:58.523264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.522845 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" event={"ID":"b49398c0-721a-4c21-a116-3b886f86d72f","Type":"ContainerDied","Data":"7dee9dcefdda3a0dcf7a30b341a9a25ba25bdc4ac595b786e6d35d3315e02067"} Jun 03 13:54:58.523264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.522861 2562 scope.go:117] "RemoveContainer" containerID="88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4" Jun 03 13:54:58.523264 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.522820 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4qsnd" Jun 03 13:54:58.531680 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.531660 2562 scope.go:117] "RemoveContainer" containerID="88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4" Jun 03 13:54:58.531976 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:54:58.531956 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4\": container with ID starting with 88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4 not found: ID does not exist" containerID="88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4" Jun 03 13:54:58.532020 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.531988 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4"} err="failed to get container status \"88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4\": rpc error: code = NotFound desc = could not find container \"88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4\": container with ID starting with 88da34cfbaa25dac7feb9d8aed6ed16a41b80bbe17ddfd343185a42f13dd0aa4 not found: ID does not exist" Jun 03 13:54:58.540023 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.539986 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4qsnd"] Jun 03 13:54:58.544647 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:58.544619 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4qsnd"] Jun 03 13:54:59.999096 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:54:59.999063 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b49398c0-721a-4c21-a116-3b886f86d72f" path="/var/lib/kubelet/pods/b49398c0-721a-4c21-a116-3b886f86d72f/volumes" Jun 03 13:55:29.867606 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.867574 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns"] Jun 03 13:55:29.868106 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.867948 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49398c0-721a-4c21-a116-3b886f86d72f" containerName="registry-server" Jun 03 13:55:29.868106 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.867959 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49398c0-721a-4c21-a116-3b886f86d72f" containerName="registry-server" Jun 03 13:55:29.868106 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.868028 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="b49398c0-721a-4c21-a116-3b886f86d72f" containerName="registry-server" Jun 03 13:55:29.872625 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.872595 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" Jun 03 13:55:29.880520 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.880478 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 13:55:29.880653 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.880539 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 13:55:29.880653 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.880567 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-56t4w\"" Jun 03 13:55:29.881475 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.881458 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 13:55:29.900841 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.900801 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns"] Jun 03 13:55:29.901975 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:29.901946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blfv6\" (UniqueName: \"kubernetes.io/projected/e0d07663-734a-463a-bd6f-6db3a2aad7d4-kube-api-access-blfv6\") pod \"dns-operator-controller-manager-648d5c98bc-562ns\" (UID: \"e0d07663-734a-463a-bd6f-6db3a2aad7d4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" Jun 03 13:55:30.003152 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:30.003112 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blfv6\" (UniqueName: \"kubernetes.io/projected/e0d07663-734a-463a-bd6f-6db3a2aad7d4-kube-api-access-blfv6\") pod \"dns-operator-controller-manager-648d5c98bc-562ns\" (UID: \"e0d07663-734a-463a-bd6f-6db3a2aad7d4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" Jun 03 13:55:30.014310 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:30.014282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blfv6\" (UniqueName: \"kubernetes.io/projected/e0d07663-734a-463a-bd6f-6db3a2aad7d4-kube-api-access-blfv6\") pod \"dns-operator-controller-manager-648d5c98bc-562ns\" (UID: \"e0d07663-734a-463a-bd6f-6db3a2aad7d4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" Jun 03 13:55:30.184435 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:30.184404 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" Jun 03 13:55:30.344115 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:30.344083 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns"] Jun 03 13:55:30.347935 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:55:30.347906 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d07663_734a_463a_bd6f_6db3a2aad7d4.slice/crio-bfdbc5f8afe6cb1a3b14dec98d6e70c32e6abaccca541f7556d12d38998422c6 WatchSource:0}: Error finding container bfdbc5f8afe6cb1a3b14dec98d6e70c32e6abaccca541f7556d12d38998422c6: Status 404 returned error can't find the container with id bfdbc5f8afe6cb1a3b14dec98d6e70c32e6abaccca541f7556d12d38998422c6 Jun 03 13:55:30.639100 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:30.639027 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" event={"ID":"e0d07663-734a-463a-bd6f-6db3a2aad7d4","Type":"ContainerStarted","Data":"bfdbc5f8afe6cb1a3b14dec98d6e70c32e6abaccca541f7556d12d38998422c6"} Jun 03 13:55:32.649320 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:32.649243 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" event={"ID":"e0d07663-734a-463a-bd6f-6db3a2aad7d4","Type":"ContainerStarted","Data":"ded0b86f9c9d8cd8ed7cd2458bcb4b3efeafbd9b56104a04e54aa8a08491e0ff"} Jun 03 13:55:32.685957 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:32.685898 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" podStartSLOduration=1.547643416 podStartE2EDuration="3.685881155s" podCreationTimestamp="2026-06-03 13:55:29 +0000 UTC" firstStartedPulling="2026-06-03 13:55:30.349837012 +0000 UTC m=+472.962242306" lastFinishedPulling="2026-06-03 13:55:32.488074548 +0000 UTC m=+475.100480045" observedRunningTime="2026-06-03 13:55:32.682336947 +0000 UTC m=+475.294742264" watchObservedRunningTime="2026-06-03 13:55:32.685881155 +0000 UTC m=+475.298286470" Jun 03 13:55:33.029724 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.029687 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v"] Jun 03 13:55:33.033202 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.033183 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:33.035718 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.035701 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-25djv\"" Jun 03 13:55:33.043441 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.043422 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v"] Jun 03 13:55:33.129419 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.129379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg46f\" (UniqueName: \"kubernetes.io/projected/424490fb-424c-427f-9823-9c7102d9aedb-kube-api-access-dg46f\") pod \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" (UID: \"424490fb-424c-427f-9823-9c7102d9aedb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:33.230914 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.230880 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dg46f\" (UniqueName: \"kubernetes.io/projected/424490fb-424c-427f-9823-9c7102d9aedb-kube-api-access-dg46f\") pod \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" (UID: \"424490fb-424c-427f-9823-9c7102d9aedb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:33.243516 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.243489 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg46f\" (UniqueName: \"kubernetes.io/projected/424490fb-424c-427f-9823-9c7102d9aedb-kube-api-access-dg46f\") pod \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" (UID: \"424490fb-424c-427f-9823-9c7102d9aedb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:33.344341 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.344198 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:33.508243 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.508198 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v"] Jun 03 13:55:33.508955 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:55:33.508930 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424490fb_424c_427f_9823_9c7102d9aedb.slice/crio-9665ddadd7a14c278f0a50c6f6097109b4f76e894551af4151cadea9c1d8623b WatchSource:0}: Error finding container 9665ddadd7a14c278f0a50c6f6097109b4f76e894551af4151cadea9c1d8623b: Status 404 returned error can't find the container with id 9665ddadd7a14c278f0a50c6f6097109b4f76e894551af4151cadea9c1d8623b Jun 03 13:55:33.654087 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.653996 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" event={"ID":"424490fb-424c-427f-9823-9c7102d9aedb","Type":"ContainerStarted","Data":"9665ddadd7a14c278f0a50c6f6097109b4f76e894551af4151cadea9c1d8623b"} Jun 03 13:55:33.654485 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:33.654245 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" Jun 03 13:55:35.663277 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:35.663148 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" event={"ID":"424490fb-424c-427f-9823-9c7102d9aedb","Type":"ContainerStarted","Data":"02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df"} Jun 03 13:55:35.663277 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:35.663252 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:35.698878 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:35.698798 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" podStartSLOduration=0.959388988 podStartE2EDuration="2.698783076s" podCreationTimestamp="2026-06-03 13:55:33 +0000 UTC" firstStartedPulling="2026-06-03 13:55:33.511491207 +0000 UTC m=+476.123896503" lastFinishedPulling="2026-06-03 13:55:35.250885293 +0000 UTC m=+477.863290591" observedRunningTime="2026-06-03 13:55:35.695801059 +0000 UTC m=+478.308206376" watchObservedRunningTime="2026-06-03 13:55:35.698783076 +0000 UTC m=+478.311188393" Jun 03 13:55:44.660273 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:44.660210 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-562ns" Jun 03 13:55:46.669578 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:46.669546 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:56.253616 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.253582 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v"] Jun 03 13:55:56.254065 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.253927 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" podUID="424490fb-424c-427f-9823-9c7102d9aedb" containerName="manager" containerID="cri-o://02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df" gracePeriod=2 Jun 03 13:55:56.269041 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.269011 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v"] Jun 03 13:55:56.288580 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.288551 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd"] Jun 03 13:55:56.288968 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.288948 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424490fb-424c-427f-9823-9c7102d9aedb" containerName="manager" Jun 03 13:55:56.288968 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.288966 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="424490fb-424c-427f-9823-9c7102d9aedb" containerName="manager" Jun 03 13:55:56.289148 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.289060 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="424490fb-424c-427f-9823-9c7102d9aedb" containerName="manager" Jun 03 13:55:56.291990 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.291972 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" Jun 03 13:55:56.312629 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.312601 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd"] Jun 03 13:55:56.456002 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.455967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qnl\" (UniqueName: \"kubernetes.io/projected/188b5442-fa85-4f3e-96fc-100146d95abb-kube-api-access-n7qnl\") pod \"limitador-operator-controller-manager-85c4996f8c-kbsnd\" (UID: \"188b5442-fa85-4f3e-96fc-100146d95abb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" Jun 03 13:55:56.479675 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.479653 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:56.487328 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.487299 2562 status_manager.go:895] "Failed to get status for pod" podUID="424490fb-424c-427f-9823-9c7102d9aedb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" err="pods \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" Jun 03 13:55:56.556856 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.556766 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qnl\" (UniqueName: \"kubernetes.io/projected/188b5442-fa85-4f3e-96fc-100146d95abb-kube-api-access-n7qnl\") pod \"limitador-operator-controller-manager-85c4996f8c-kbsnd\" (UID: \"188b5442-fa85-4f3e-96fc-100146d95abb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" Jun 03 13:55:56.568669 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.568641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qnl\" (UniqueName: \"kubernetes.io/projected/188b5442-fa85-4f3e-96fc-100146d95abb-kube-api-access-n7qnl\") pod \"limitador-operator-controller-manager-85c4996f8c-kbsnd\" (UID: \"188b5442-fa85-4f3e-96fc-100146d95abb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" Jun 03 13:55:56.639638 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.639601 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" Jun 03 13:55:56.657648 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.657608 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg46f\" (UniqueName: \"kubernetes.io/projected/424490fb-424c-427f-9823-9c7102d9aedb-kube-api-access-dg46f\") pod \"424490fb-424c-427f-9823-9c7102d9aedb\" (UID: \"424490fb-424c-427f-9823-9c7102d9aedb\") " Jun 03 13:55:56.659587 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.659558 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424490fb-424c-427f-9823-9c7102d9aedb-kube-api-access-dg46f" (OuterVolumeSpecName: "kube-api-access-dg46f") pod "424490fb-424c-427f-9823-9c7102d9aedb" (UID: "424490fb-424c-427f-9823-9c7102d9aedb"). InnerVolumeSpecName "kube-api-access-dg46f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:55:56.745794 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.745762 2562 generic.go:358] "Generic (PLEG): container finished" podID="424490fb-424c-427f-9823-9c7102d9aedb" containerID="02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df" exitCode=0 Jun 03 13:55:56.745958 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.745805 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" Jun 03 13:55:56.745958 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.745826 2562 scope.go:117] "RemoveContainer" containerID="02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df" Jun 03 13:55:56.748173 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.748143 2562 status_manager.go:895] "Failed to get status for pod" podUID="424490fb-424c-427f-9823-9c7102d9aedb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" err="pods \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" Jun 03 13:55:56.754954 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.754928 2562 scope.go:117] "RemoveContainer" containerID="02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df" Jun 03 13:55:56.755354 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:55:56.755297 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df\": container with ID starting with 02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df not found: ID does not exist" containerID="02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df" Jun 03 13:55:56.755354 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.755325 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df"} err="failed to get container status \"02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df\": rpc error: code = NotFound desc = could not find container \"02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df\": container with ID starting with 02d42e06df90627e90c3bb403a5fde640f2559ed3d25f33af70ea673e0bea7df not found: ID does not exist" Jun 03 13:55:56.759283 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.759261 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg46f\" (UniqueName: \"kubernetes.io/projected/424490fb-424c-427f-9823-9c7102d9aedb-kube-api-access-dg46f\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:55:56.759488 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.759466 2562 status_manager.go:895] "Failed to get status for pod" podUID="424490fb-424c-427f-9823-9c7102d9aedb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" err="pods \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" Jun 03 13:55:56.785577 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:56.785540 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd"] Jun 03 13:55:56.788410 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:55:56.788375 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188b5442_fa85_4f3e_96fc_100146d95abb.slice/crio-fffdb4261c95c63c97f5ae1389c685b44f74aed8dfd90325e0ea6d92c19866ca WatchSource:0}: Error finding container fffdb4261c95c63c97f5ae1389c685b44f74aed8dfd90325e0ea6d92c19866ca: Status 404 returned error can't find the container with id fffdb4261c95c63c97f5ae1389c685b44f74aed8dfd90325e0ea6d92c19866ca Jun 03 13:55:57.751310 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:57.751277 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" event={"ID":"188b5442-fa85-4f3e-96fc-100146d95abb","Type":"ContainerStarted","Data":"8061cab961b37b45fdadaa0616b64b3bca32722426abafe199cfa4627ba7ba55"} Jun 03 13:55:57.751310 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:57.751315 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" event={"ID":"188b5442-fa85-4f3e-96fc-100146d95abb","Type":"ContainerStarted","Data":"fffdb4261c95c63c97f5ae1389c685b44f74aed8dfd90325e0ea6d92c19866ca"} Jun 03 13:55:57.751711 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:57.751423 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" Jun 03 13:55:57.753622 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:57.753598 2562 status_manager.go:895] "Failed to get status for pod" podUID="424490fb-424c-427f-9823-9c7102d9aedb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" err="pods \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" Jun 03 13:55:57.776591 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:57.776544 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" podStartSLOduration=1.77653064 podStartE2EDuration="1.77653064s" podCreationTimestamp="2026-06-03 13:55:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:55:57.772706752 +0000 UTC m=+500.385112068" watchObservedRunningTime="2026-06-03 13:55:57.77653064 +0000 UTC m=+500.388935998" Jun 03 13:55:58.000119 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:58.000067 2562 status_manager.go:895] "Failed to get status for pod" podUID="424490fb-424c-427f-9823-9c7102d9aedb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gwb7v" err="pods \"limitador-operator-controller-manager-85c4996f8c-gwb7v\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" Jun 03 13:55:58.002636 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:55:58.002559 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="424490fb-424c-427f-9823-9c7102d9aedb" path="/var/lib/kubelet/pods/424490fb-424c-427f-9823-9c7102d9aedb/volumes" Jun 03 13:56:08.757382 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:08.757351 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kbsnd" Jun 03 13:56:39.363803 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.363763 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 13:56:39.368683 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.368661 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.371127 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.371106 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 13:56:39.371270 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.371126 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-57sf8\"" Jun 03 13:56:39.378268 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.378241 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 13:56:39.406927 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.406892 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 13:56:39.458841 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.458806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff70957f-b6d9-4135-8056-a19a6754b487-config-file\") pod \"limitador-limitador-78c99df468-2bbr6\" (UID: \"ff70957f-b6d9-4135-8056-a19a6754b487\") " pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.459016 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.458876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g46wr\" (UniqueName: \"kubernetes.io/projected/ff70957f-b6d9-4135-8056-a19a6754b487-kube-api-access-g46wr\") pod \"limitador-limitador-78c99df468-2bbr6\" (UID: \"ff70957f-b6d9-4135-8056-a19a6754b487\") " pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.559307 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.559279 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g46wr\" (UniqueName: \"kubernetes.io/projected/ff70957f-b6d9-4135-8056-a19a6754b487-kube-api-access-g46wr\") pod \"limitador-limitador-78c99df468-2bbr6\" (UID: \"ff70957f-b6d9-4135-8056-a19a6754b487\") " pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.559495 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.559342 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff70957f-b6d9-4135-8056-a19a6754b487-config-file\") pod \"limitador-limitador-78c99df468-2bbr6\" (UID: \"ff70957f-b6d9-4135-8056-a19a6754b487\") " pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.559878 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.559860 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff70957f-b6d9-4135-8056-a19a6754b487-config-file\") pod \"limitador-limitador-78c99df468-2bbr6\" (UID: \"ff70957f-b6d9-4135-8056-a19a6754b487\") " pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.567744 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.567719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g46wr\" (UniqueName: \"kubernetes.io/projected/ff70957f-b6d9-4135-8056-a19a6754b487-kube-api-access-g46wr\") pod \"limitador-limitador-78c99df468-2bbr6\" (UID: \"ff70957f-b6d9-4135-8056-a19a6754b487\") " pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.680003 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.679958 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:39.811574 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.811535 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 13:56:39.814208 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:56:39.814179 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff70957f_b6d9_4135_8056_a19a6754b487.slice/crio-266a82e17fda4ce25f2bf0a10d6652b48d9bf2d38470245dfaf3ebded972e48d WatchSource:0}: Error finding container 266a82e17fda4ce25f2bf0a10d6652b48d9bf2d38470245dfaf3ebded972e48d: Status 404 returned error can't find the container with id 266a82e17fda4ce25f2bf0a10d6652b48d9bf2d38470245dfaf3ebded972e48d Jun 03 13:56:39.911149 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.911115 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" event={"ID":"ff70957f-b6d9-4135-8056-a19a6754b487","Type":"ContainerStarted","Data":"266a82e17fda4ce25f2bf0a10d6652b48d9bf2d38470245dfaf3ebded972e48d"} Jun 03 13:56:39.954438 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.954357 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-ll5vk"] Jun 03 13:56:39.959091 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.959071 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ll5vk" Jun 03 13:56:39.961514 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.961497 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pgjmg\"" Jun 03 13:56:39.964779 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:39.964756 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ll5vk"] Jun 03 13:56:40.063831 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:40.063795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9tpv\" (UniqueName: \"kubernetes.io/projected/e924a0ab-8752-436d-a0af-3b113acfd828-kube-api-access-h9tpv\") pod \"authorino-7498df8756-ll5vk\" (UID: \"e924a0ab-8752-436d-a0af-3b113acfd828\") " pod="kuadrant-system/authorino-7498df8756-ll5vk" Jun 03 13:56:40.164769 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:40.164730 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9tpv\" (UniqueName: \"kubernetes.io/projected/e924a0ab-8752-436d-a0af-3b113acfd828-kube-api-access-h9tpv\") pod \"authorino-7498df8756-ll5vk\" (UID: \"e924a0ab-8752-436d-a0af-3b113acfd828\") " pod="kuadrant-system/authorino-7498df8756-ll5vk" Jun 03 13:56:40.173311 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:40.173280 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9tpv\" (UniqueName: \"kubernetes.io/projected/e924a0ab-8752-436d-a0af-3b113acfd828-kube-api-access-h9tpv\") pod \"authorino-7498df8756-ll5vk\" (UID: \"e924a0ab-8752-436d-a0af-3b113acfd828\") " pod="kuadrant-system/authorino-7498df8756-ll5vk" Jun 03 13:56:40.269411 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:40.269290 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ll5vk" Jun 03 13:56:40.445110 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:40.445073 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ll5vk"] Jun 03 13:56:40.450962 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:56:40.450930 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode924a0ab_8752_436d_a0af_3b113acfd828.slice/crio-b16cdf4da88a04e9124b58ebb994e872543d785bfbed0e724db584f85d1d7f75 WatchSource:0}: Error finding container b16cdf4da88a04e9124b58ebb994e872543d785bfbed0e724db584f85d1d7f75: Status 404 returned error can't find the container with id b16cdf4da88a04e9124b58ebb994e872543d785bfbed0e724db584f85d1d7f75 Jun 03 13:56:40.916083 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:40.916048 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ll5vk" event={"ID":"e924a0ab-8752-436d-a0af-3b113acfd828","Type":"ContainerStarted","Data":"b16cdf4da88a04e9124b58ebb994e872543d785bfbed0e724db584f85d1d7f75"} Jun 03 13:56:44.934545 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:44.934504 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" event={"ID":"ff70957f-b6d9-4135-8056-a19a6754b487","Type":"ContainerStarted","Data":"0f0611a58deb651ffaf939e3b0f9115efc4ee16a403cae9448c36621e51f3d2a"} Jun 03 13:56:44.934999 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:44.934559 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:56:44.935865 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:44.935846 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ll5vk" event={"ID":"e924a0ab-8752-436d-a0af-3b113acfd828","Type":"ContainerStarted","Data":"889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b"} Jun 03 13:56:44.951819 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:44.951769 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" podStartSLOduration=1.596944876 podStartE2EDuration="5.951756306s" podCreationTimestamp="2026-06-03 13:56:39 +0000 UTC" firstStartedPulling="2026-06-03 13:56:39.816150637 +0000 UTC m=+542.428555932" lastFinishedPulling="2026-06-03 13:56:44.170962068 +0000 UTC m=+546.783367362" observedRunningTime="2026-06-03 13:56:44.950715008 +0000 UTC m=+547.563120336" watchObservedRunningTime="2026-06-03 13:56:44.951756306 +0000 UTC m=+547.564161624" Jun 03 13:56:44.968400 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:44.968345 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-ll5vk" podStartSLOduration=2.244319097 podStartE2EDuration="5.968330107s" podCreationTimestamp="2026-06-03 13:56:39 +0000 UTC" firstStartedPulling="2026-06-03 13:56:40.452793177 +0000 UTC m=+543.065198474" lastFinishedPulling="2026-06-03 13:56:44.176804188 +0000 UTC m=+546.789209484" observedRunningTime="2026-06-03 13:56:44.965943208 +0000 UTC m=+547.578348523" watchObservedRunningTime="2026-06-03 13:56:44.968330107 +0000 UTC m=+547.580735417" Jun 03 13:56:55.941308 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:56:55.941278 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-2bbr6" Jun 03 13:58:04.949649 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:04.949551 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vwd4"] Jun 03 13:58:04.953200 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:04.953178 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" Jun 03 13:58:04.959621 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:04.959595 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vwd4"] Jun 03 13:58:05.051745 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.051708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb46x\" (UniqueName: \"kubernetes.io/projected/adbd667c-8a46-4527-a333-e8e48e0d8042-kube-api-access-zb46x\") pod \"authorino-8b475cf9f-8vwd4\" (UID: \"adbd667c-8a46-4527-a333-e8e48e0d8042\") " pod="kuadrant-system/authorino-8b475cf9f-8vwd4" Jun 03 13:58:05.153083 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.153051 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zb46x\" (UniqueName: \"kubernetes.io/projected/adbd667c-8a46-4527-a333-e8e48e0d8042-kube-api-access-zb46x\") pod \"authorino-8b475cf9f-8vwd4\" (UID: \"adbd667c-8a46-4527-a333-e8e48e0d8042\") " pod="kuadrant-system/authorino-8b475cf9f-8vwd4" Jun 03 13:58:05.162130 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.162100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb46x\" (UniqueName: \"kubernetes.io/projected/adbd667c-8a46-4527-a333-e8e48e0d8042-kube-api-access-zb46x\") pod \"authorino-8b475cf9f-8vwd4\" (UID: \"adbd667c-8a46-4527-a333-e8e48e0d8042\") " pod="kuadrant-system/authorino-8b475cf9f-8vwd4" Jun 03 13:58:05.191884 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.191846 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vwd4"] Jun 03 13:58:05.192146 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.192130 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" Jun 03 13:58:05.221206 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.221176 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cb446b69c-pcxg9"] Jun 03 13:58:05.226496 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.226470 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb446b69c-pcxg9" Jun 03 13:58:05.231777 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.231751 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cb446b69c-pcxg9"] Jun 03 13:58:05.254443 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.254351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw4hw\" (UniqueName: \"kubernetes.io/projected/25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff-kube-api-access-fw4hw\") pod \"authorino-cb446b69c-pcxg9\" (UID: \"25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff\") " pod="kuadrant-system/authorino-cb446b69c-pcxg9" Jun 03 13:58:05.254937 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.254909 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cb446b69c-pcxg9"] Jun 03 13:58:05.255345 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:58:05.255260 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fw4hw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-cb446b69c-pcxg9" podUID="25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff" Jun 03 13:58:05.334335 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.334297 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vwd4"] Jun 03 13:58:05.337493 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:58:05.337457 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadbd667c_8a46_4527_a333_e8e48e0d8042.slice/crio-3d5362e3fd6a43e59802330291ed3b9ddee9028a27525d488b9f6bc4e6eb3196 WatchSource:0}: Error finding container 3d5362e3fd6a43e59802330291ed3b9ddee9028a27525d488b9f6bc4e6eb3196: Status 404 returned error can't find the container with id 3d5362e3fd6a43e59802330291ed3b9ddee9028a27525d488b9f6bc4e6eb3196 Jun 03 13:58:05.355043 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.355011 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fw4hw\" (UniqueName: \"kubernetes.io/projected/25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff-kube-api-access-fw4hw\") pod \"authorino-cb446b69c-pcxg9\" (UID: \"25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff\") " pod="kuadrant-system/authorino-cb446b69c-pcxg9" Jun 03 13:58:05.364413 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:05.364380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw4hw\" (UniqueName: \"kubernetes.io/projected/25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff-kube-api-access-fw4hw\") pod \"authorino-cb446b69c-pcxg9\" (UID: \"25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff\") " pod="kuadrant-system/authorino-cb446b69c-pcxg9" Jun 03 13:58:06.223187 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.223152 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" event={"ID":"adbd667c-8a46-4527-a333-e8e48e0d8042","Type":"ContainerStarted","Data":"3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc"} Jun 03 13:58:06.223187 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.223188 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" event={"ID":"adbd667c-8a46-4527-a333-e8e48e0d8042","Type":"ContainerStarted","Data":"3d5362e3fd6a43e59802330291ed3b9ddee9028a27525d488b9f6bc4e6eb3196"} Jun 03 13:58:06.223187 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.223175 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" podUID="adbd667c-8a46-4527-a333-e8e48e0d8042" containerName="authorino" containerID="cri-o://3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc" gracePeriod=30 Jun 03 13:58:06.223829 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.223241 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb446b69c-pcxg9" Jun 03 13:58:06.228929 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.228901 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb446b69c-pcxg9" Jun 03 13:58:06.238672 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.238630 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" podStartSLOduration=1.779805165 podStartE2EDuration="2.238615462s" podCreationTimestamp="2026-06-03 13:58:04 +0000 UTC" firstStartedPulling="2026-06-03 13:58:05.338801824 +0000 UTC m=+627.951207117" lastFinishedPulling="2026-06-03 13:58:05.797612116 +0000 UTC m=+628.410017414" observedRunningTime="2026-06-03 13:58:06.237818083 +0000 UTC m=+628.850223399" watchObservedRunningTime="2026-06-03 13:58:06.238615462 +0000 UTC m=+628.851020778" Jun 03 13:58:06.264294 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.264262 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw4hw\" (UniqueName: \"kubernetes.io/projected/25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff-kube-api-access-fw4hw\") pod \"25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff\" (UID: \"25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff\") " Jun 03 13:58:06.266355 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.266327 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff-kube-api-access-fw4hw" (OuterVolumeSpecName: "kube-api-access-fw4hw") pod "25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff" (UID: "25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff"). InnerVolumeSpecName "kube-api-access-fw4hw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:06.331923 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.331880 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ll5vk"] Jun 03 13:58:06.332128 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.332095 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-ll5vk" podUID="e924a0ab-8752-436d-a0af-3b113acfd828" containerName="authorino" containerID="cri-o://889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b" gracePeriod=30 Jun 03 13:58:06.365015 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.364984 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw4hw\" (UniqueName: \"kubernetes.io/projected/25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff-kube-api-access-fw4hw\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:58:06.458535 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.458512 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" Jun 03 13:58:06.566897 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.566857 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb46x\" (UniqueName: \"kubernetes.io/projected/adbd667c-8a46-4527-a333-e8e48e0d8042-kube-api-access-zb46x\") pod \"adbd667c-8a46-4527-a333-e8e48e0d8042\" (UID: \"adbd667c-8a46-4527-a333-e8e48e0d8042\") " Jun 03 13:58:06.568885 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.568849 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adbd667c-8a46-4527-a333-e8e48e0d8042-kube-api-access-zb46x" (OuterVolumeSpecName: "kube-api-access-zb46x") pod "adbd667c-8a46-4527-a333-e8e48e0d8042" (UID: "adbd667c-8a46-4527-a333-e8e48e0d8042"). InnerVolumeSpecName "kube-api-access-zb46x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:06.574362 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.574344 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ll5vk" Jun 03 13:58:06.667503 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.667464 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9tpv\" (UniqueName: \"kubernetes.io/projected/e924a0ab-8752-436d-a0af-3b113acfd828-kube-api-access-h9tpv\") pod \"e924a0ab-8752-436d-a0af-3b113acfd828\" (UID: \"e924a0ab-8752-436d-a0af-3b113acfd828\") " Jun 03 13:58:06.667675 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.667665 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb46x\" (UniqueName: \"kubernetes.io/projected/adbd667c-8a46-4527-a333-e8e48e0d8042-kube-api-access-zb46x\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:58:06.669580 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.669553 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e924a0ab-8752-436d-a0af-3b113acfd828-kube-api-access-h9tpv" (OuterVolumeSpecName: "kube-api-access-h9tpv") pod "e924a0ab-8752-436d-a0af-3b113acfd828" (UID: "e924a0ab-8752-436d-a0af-3b113acfd828"). InnerVolumeSpecName "kube-api-access-h9tpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:06.769118 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:06.769031 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9tpv\" (UniqueName: \"kubernetes.io/projected/e924a0ab-8752-436d-a0af-3b113acfd828-kube-api-access-h9tpv\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 13:58:07.233362 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.233326 2562 generic.go:358] "Generic (PLEG): container finished" podID="adbd667c-8a46-4527-a333-e8e48e0d8042" containerID="3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc" exitCode=0 Jun 03 13:58:07.233798 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.233393 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" Jun 03 13:58:07.233798 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.233407 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" event={"ID":"adbd667c-8a46-4527-a333-e8e48e0d8042","Type":"ContainerDied","Data":"3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc"} Jun 03 13:58:07.233798 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.233444 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-8vwd4" event={"ID":"adbd667c-8a46-4527-a333-e8e48e0d8042","Type":"ContainerDied","Data":"3d5362e3fd6a43e59802330291ed3b9ddee9028a27525d488b9f6bc4e6eb3196"} Jun 03 13:58:07.233798 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.233462 2562 scope.go:117] "RemoveContainer" containerID="3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc" Jun 03 13:58:07.234610 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.234537 2562 generic.go:358] "Generic (PLEG): container finished" podID="e924a0ab-8752-436d-a0af-3b113acfd828" containerID="889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b" exitCode=0 Jun 03 13:58:07.234610 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.234564 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ll5vk" event={"ID":"e924a0ab-8752-436d-a0af-3b113acfd828","Type":"ContainerDied","Data":"889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b"} Jun 03 13:58:07.234610 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.234590 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ll5vk" event={"ID":"e924a0ab-8752-436d-a0af-3b113acfd828","Type":"ContainerDied","Data":"b16cdf4da88a04e9124b58ebb994e872543d785bfbed0e724db584f85d1d7f75"} Jun 03 13:58:07.234610 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.234604 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ll5vk" Jun 03 13:58:07.234833 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.234816 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb446b69c-pcxg9" Jun 03 13:58:07.243721 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.243702 2562 scope.go:117] "RemoveContainer" containerID="3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc" Jun 03 13:58:07.244003 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:58:07.243976 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc\": container with ID starting with 3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc not found: ID does not exist" containerID="3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc" Jun 03 13:58:07.244104 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.244012 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc"} err="failed to get container status \"3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc\": rpc error: code = NotFound desc = could not find container \"3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc\": container with ID starting with 3f2ac148c596e00c5f8003d33d932ae9a744ef4f1dd4a02d992fd10c6c89dbdc not found: ID does not exist" Jun 03 13:58:07.244104 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.244035 2562 scope.go:117] "RemoveContainer" containerID="889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b" Jun 03 13:58:07.252094 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.252074 2562 scope.go:117] "RemoveContainer" containerID="889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b" Jun 03 13:58:07.252380 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:58:07.252362 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b\": container with ID starting with 889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b not found: ID does not exist" containerID="889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b" Jun 03 13:58:07.252437 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.252388 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b"} err="failed to get container status \"889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b\": rpc error: code = NotFound desc = could not find container \"889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b\": container with ID starting with 889001ca322b12e4f31d1075c92d8af6c5c67c80764d2e2c0537ef36aa4d9e4b not found: ID does not exist" Jun 03 13:58:07.266823 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.266793 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cb446b69c-pcxg9"] Jun 03 13:58:07.269076 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.269054 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cb446b69c-pcxg9"] Jun 03 13:58:07.282357 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.282334 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vwd4"] Jun 03 13:58:07.286447 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.286426 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vwd4"] Jun 03 13:58:07.297058 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.297035 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ll5vk"] Jun 03 13:58:07.302873 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.302849 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-ll5vk"] Jun 03 13:58:07.999449 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.999413 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff" path="/var/lib/kubelet/pods/25ca7b62-2bb6-4f5b-a98f-cb47bb3be4ff/volumes" Jun 03 13:58:07.999644 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.999631 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adbd667c-8a46-4527-a333-e8e48e0d8042" path="/var/lib/kubelet/pods/adbd667c-8a46-4527-a333-e8e48e0d8042/volumes" Jun 03 13:58:07.999908 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:07.999898 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e924a0ab-8752-436d-a0af-3b113acfd828" path="/var/lib/kubelet/pods/e924a0ab-8752-436d-a0af-3b113acfd828/volumes" Jun 03 13:58:42.967457 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.967417 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-84c5cc9c76-8qmqp"] Jun 03 13:58:42.967877 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.967793 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adbd667c-8a46-4527-a333-e8e48e0d8042" containerName="authorino" Jun 03 13:58:42.967877 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.967805 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="adbd667c-8a46-4527-a333-e8e48e0d8042" containerName="authorino" Jun 03 13:58:42.967877 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.967822 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e924a0ab-8752-436d-a0af-3b113acfd828" containerName="authorino" Jun 03 13:58:42.967877 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.967827 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e924a0ab-8752-436d-a0af-3b113acfd828" containerName="authorino" Jun 03 13:58:42.968006 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.967893 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="e924a0ab-8752-436d-a0af-3b113acfd828" containerName="authorino" Jun 03 13:58:42.968006 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.967901 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="adbd667c-8a46-4527-a333-e8e48e0d8042" containerName="authorino" Jun 03 13:58:42.972419 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.972392 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:42.974826 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.974803 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t2tmj\"" Jun 03 13:58:42.975024 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.975008 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 13:58:42.980257 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.980212 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-84c5cc9c76-8qmqp"] Jun 03 13:58:42.988673 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.988648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/161eec19-1813-4519-a7e4-0e712e868cc1-maas-api-tls\") pod \"maas-api-84c5cc9c76-8qmqp\" (UID: \"161eec19-1813-4519-a7e4-0e712e868cc1\") " pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:42.988814 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:42.988709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pk62\" (UniqueName: \"kubernetes.io/projected/161eec19-1813-4519-a7e4-0e712e868cc1-kube-api-access-9pk62\") pod \"maas-api-84c5cc9c76-8qmqp\" (UID: \"161eec19-1813-4519-a7e4-0e712e868cc1\") " pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:43.089167 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:43.089128 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/161eec19-1813-4519-a7e4-0e712e868cc1-maas-api-tls\") pod \"maas-api-84c5cc9c76-8qmqp\" (UID: \"161eec19-1813-4519-a7e4-0e712e868cc1\") " pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:43.089387 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:43.089191 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pk62\" (UniqueName: \"kubernetes.io/projected/161eec19-1813-4519-a7e4-0e712e868cc1-kube-api-access-9pk62\") pod \"maas-api-84c5cc9c76-8qmqp\" (UID: \"161eec19-1813-4519-a7e4-0e712e868cc1\") " pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:43.089387 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:58:43.089316 2562 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 03 13:58:43.089504 ip-10-0-139-48 kubenswrapper[2562]: E0603 13:58:43.089396 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161eec19-1813-4519-a7e4-0e712e868cc1-maas-api-tls podName:161eec19-1813-4519-a7e4-0e712e868cc1 nodeName:}" failed. No retries permitted until 2026-06-03 13:58:43.589371029 +0000 UTC m=+666.201776325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/161eec19-1813-4519-a7e4-0e712e868cc1-maas-api-tls") pod "maas-api-84c5cc9c76-8qmqp" (UID: "161eec19-1813-4519-a7e4-0e712e868cc1") : secret "maas-api-serving-cert" not found Jun 03 13:58:43.098522 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:43.098496 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pk62\" (UniqueName: \"kubernetes.io/projected/161eec19-1813-4519-a7e4-0e712e868cc1-kube-api-access-9pk62\") pod \"maas-api-84c5cc9c76-8qmqp\" (UID: \"161eec19-1813-4519-a7e4-0e712e868cc1\") " pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:43.541678 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:43.541640 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 13:58:43.594617 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:43.594581 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/161eec19-1813-4519-a7e4-0e712e868cc1-maas-api-tls\") pod \"maas-api-84c5cc9c76-8qmqp\" (UID: \"161eec19-1813-4519-a7e4-0e712e868cc1\") " pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:43.597094 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:43.597062 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/161eec19-1813-4519-a7e4-0e712e868cc1-maas-api-tls\") pod \"maas-api-84c5cc9c76-8qmqp\" (UID: \"161eec19-1813-4519-a7e4-0e712e868cc1\") " pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:43.883893 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:43.883801 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:44.014317 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:44.014292 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-84c5cc9c76-8qmqp"] Jun 03 13:58:44.016557 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:58:44.016530 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161eec19_1813_4519_a7e4_0e712e868cc1.slice/crio-e85f69cead411a0c7fe4e1c792b9a74cd3340e71724533363b210fc89ccfdc3d WatchSource:0}: Error finding container e85f69cead411a0c7fe4e1c792b9a74cd3340e71724533363b210fc89ccfdc3d: Status 404 returned error can't find the container with id e85f69cead411a0c7fe4e1c792b9a74cd3340e71724533363b210fc89ccfdc3d Jun 03 13:58:44.017754 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:44.017737 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 13:58:44.367299 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:44.367259 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-84c5cc9c76-8qmqp" event={"ID":"161eec19-1813-4519-a7e4-0e712e868cc1","Type":"ContainerStarted","Data":"e85f69cead411a0c7fe4e1c792b9a74cd3340e71724533363b210fc89ccfdc3d"} Jun 03 13:58:46.376481 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:46.376433 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-84c5cc9c76-8qmqp" event={"ID":"161eec19-1813-4519-a7e4-0e712e868cc1","Type":"ContainerStarted","Data":"225e7ee70adac0738ee22beccf71da2f11bcf1d058f38dcec803a656c013a271"} Jun 03 13:58:46.376872 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:46.376565 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:58:46.393917 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:46.393862 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-84c5cc9c76-8qmqp" podStartSLOduration=2.191016125 podStartE2EDuration="4.393850504s" podCreationTimestamp="2026-06-03 13:58:42 +0000 UTC" firstStartedPulling="2026-06-03 13:58:44.01785789 +0000 UTC m=+666.630263185" lastFinishedPulling="2026-06-03 13:58:46.22069227 +0000 UTC m=+668.833097564" observedRunningTime="2026-06-03 13:58:46.393024511 +0000 UTC m=+669.005429827" watchObservedRunningTime="2026-06-03 13:58:46.393850504 +0000 UTC m=+669.006255819" Jun 03 13:58:52.386068 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:58:52.386034 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-84c5cc9c76-8qmqp" Jun 03 13:59:31.735719 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.735639 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-767dccccd7-zqkl8"] Jun 03 13:59:31.739212 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.739192 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.743026 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.742997 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 13:59:31.743149 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.742997 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 13:59:31.743149 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.743007 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pgjmg\"" Jun 03 13:59:31.748786 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.748752 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-767dccccd7-zqkl8"] Jun 03 13:59:31.849946 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.849907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87pj4\" (UniqueName: \"kubernetes.io/projected/7d737398-1e69-4e9a-9544-97315d92d5ea-kube-api-access-87pj4\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.850128 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.849958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d737398-1e69-4e9a-9544-97315d92d5ea-oidc-ca\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.850128 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.849981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d737398-1e69-4e9a-9544-97315d92d5ea-tls-cert\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.950653 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.950611 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d737398-1e69-4e9a-9544-97315d92d5ea-oidc-ca\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.950653 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.950661 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d737398-1e69-4e9a-9544-97315d92d5ea-tls-cert\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.950858 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.950735 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87pj4\" (UniqueName: \"kubernetes.io/projected/7d737398-1e69-4e9a-9544-97315d92d5ea-kube-api-access-87pj4\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.951488 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.951458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d737398-1e69-4e9a-9544-97315d92d5ea-oidc-ca\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.953120 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.953100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d737398-1e69-4e9a-9544-97315d92d5ea-tls-cert\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:31.959431 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:31.959408 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87pj4\" (UniqueName: \"kubernetes.io/projected/7d737398-1e69-4e9a-9544-97315d92d5ea-kube-api-access-87pj4\") pod \"authorino-767dccccd7-zqkl8\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:32.049891 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:32.049804 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 13:59:32.183154 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:32.183129 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-767dccccd7-zqkl8"] Jun 03 13:59:32.186195 ip-10-0-139-48 kubenswrapper[2562]: W0603 13:59:32.186164 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d737398_1e69_4e9a_9544_97315d92d5ea.slice/crio-b23c9a1b2f1119d0d4bf870ef88234f77d26cbca4e562d27b5ca6b68b4b427c3 WatchSource:0}: Error finding container b23c9a1b2f1119d0d4bf870ef88234f77d26cbca4e562d27b5ca6b68b4b427c3: Status 404 returned error can't find the container with id b23c9a1b2f1119d0d4bf870ef88234f77d26cbca4e562d27b5ca6b68b4b427c3 Jun 03 13:59:32.542523 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:32.542479 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767dccccd7-zqkl8" event={"ID":"7d737398-1e69-4e9a-9544-97315d92d5ea","Type":"ContainerStarted","Data":"b23c9a1b2f1119d0d4bf870ef88234f77d26cbca4e562d27b5ca6b68b4b427c3"} Jun 03 13:59:33.554592 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:33.554546 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767dccccd7-zqkl8" event={"ID":"7d737398-1e69-4e9a-9544-97315d92d5ea","Type":"ContainerStarted","Data":"48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551"} Jun 03 13:59:33.571580 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:33.571525 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-767dccccd7-zqkl8" podStartSLOduration=2.189460179 podStartE2EDuration="2.571511241s" podCreationTimestamp="2026-06-03 13:59:31 +0000 UTC" firstStartedPulling="2026-06-03 13:59:32.187911985 +0000 UTC m=+714.800317279" lastFinishedPulling="2026-06-03 13:59:32.569963044 +0000 UTC m=+715.182368341" observedRunningTime="2026-06-03 13:59:33.570148627 +0000 UTC m=+716.182553943" watchObservedRunningTime="2026-06-03 13:59:33.571511241 +0000 UTC m=+716.183916557" Jun 03 13:59:40.004872 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:40.004839 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 13:59:55.300139 ip-10-0-139-48 kubenswrapper[2562]: I0603 13:59:55.300106 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:00:04.059489 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:04.059452 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:00:22.101746 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:22.101704 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:00:39.509867 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:39.509828 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:00:55.018716 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.018619 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t"] Jun 03 14:00:55.022548 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.022523 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.026154 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.026130 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9j6mr\"" Jun 03 14:00:55.027298 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.027281 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 14:00:55.027298 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.027289 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 14:00:55.027541 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.027526 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 14:00:55.047983 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.047945 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t"] Jun 03 14:00:55.139105 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.139077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/997b5f91-df5b-4438-b6a6-abc5aacef3de-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.139295 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.139113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.139295 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.139135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5jsc\" (UniqueName: \"kubernetes.io/projected/997b5f91-df5b-4438-b6a6-abc5aacef3de-kube-api-access-c5jsc\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.139295 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.139277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.139409 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.139364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.139460 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.139442 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240334 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240295 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240511 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240357 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240511 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240399 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/997b5f91-df5b-4438-b6a6-abc5aacef3de-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240511 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240417 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240511 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240433 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5jsc\" (UniqueName: \"kubernetes.io/projected/997b5f91-df5b-4438-b6a6-abc5aacef3de-kube-api-access-c5jsc\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240511 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240490 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240784 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240784 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.240862 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.240824 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.242673 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.242649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/997b5f91-df5b-4438-b6a6-abc5aacef3de-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.242947 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.242926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/997b5f91-df5b-4438-b6a6-abc5aacef3de-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.248852 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.248829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5jsc\" (UniqueName: \"kubernetes.io/projected/997b5f91-df5b-4438-b6a6-abc5aacef3de-kube-api-access-c5jsc\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t\" (UID: \"997b5f91-df5b-4438-b6a6-abc5aacef3de\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.332507 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.332418 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:00:55.463590 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.463563 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t"] Jun 03 14:00:55.465732 ip-10-0-139-48 kubenswrapper[2562]: W0603 14:00:55.465703 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997b5f91_df5b_4438_b6a6_abc5aacef3de.slice/crio-c106820597088e3ac7ab3fb98119f0df9ffbff333f71110aac032259baf4f682 WatchSource:0}: Error finding container c106820597088e3ac7ab3fb98119f0df9ffbff333f71110aac032259baf4f682: Status 404 returned error can't find the container with id c106820597088e3ac7ab3fb98119f0df9ffbff333f71110aac032259baf4f682 Jun 03 14:00:55.853824 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:55.853791 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" event={"ID":"997b5f91-df5b-4438-b6a6-abc5aacef3de","Type":"ContainerStarted","Data":"c106820597088e3ac7ab3fb98119f0df9ffbff333f71110aac032259baf4f682"} Jun 03 14:00:56.608292 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:56.608254 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:00:59.869611 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:00:59.869520 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" event={"ID":"997b5f91-df5b-4438-b6a6-abc5aacef3de","Type":"ContainerStarted","Data":"a8dc77285c4f6af9c0ba25871ff72be3ee4a808b2a35f7903864b7c66268b8fa"} Jun 03 14:02:14.149643 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:14.149607 2562 generic.go:358] "Generic (PLEG): container finished" podID="997b5f91-df5b-4438-b6a6-abc5aacef3de" containerID="a8dc77285c4f6af9c0ba25871ff72be3ee4a808b2a35f7903864b7c66268b8fa" exitCode=0 Jun 03 14:02:14.150390 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:14.149680 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" event={"ID":"997b5f91-df5b-4438-b6a6-abc5aacef3de","Type":"ContainerDied","Data":"a8dc77285c4f6af9c0ba25871ff72be3ee4a808b2a35f7903864b7c66268b8fa"} Jun 03 14:02:16.159890 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:16.159846 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" event={"ID":"997b5f91-df5b-4438-b6a6-abc5aacef3de","Type":"ContainerStarted","Data":"1b67c9f9254fd009eeb2d493d33fa7d0e67073b2ef83af520d59dd91ad59c726"} Jun 03 14:02:16.180011 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:16.179952 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" podStartSLOduration=2.132071738 podStartE2EDuration="1m22.179935217s" podCreationTimestamp="2026-06-03 14:00:54 +0000 UTC" firstStartedPulling="2026-06-03 14:00:55.467487905 +0000 UTC m=+798.079893198" lastFinishedPulling="2026-06-03 14:02:15.515351378 +0000 UTC m=+878.127756677" observedRunningTime="2026-06-03 14:02:16.178019095 +0000 UTC m=+878.790424411" watchObservedRunningTime="2026-06-03 14:02:16.179935217 +0000 UTC m=+878.792340585" Jun 03 14:02:25.333387 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:25.333294 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:02:25.333387 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:25.333343 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:02:25.346193 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:25.346168 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:02:26.205677 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:26.205648 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t" Jun 03 14:02:27.321800 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.321767 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c7dc5b6f4-qbcbc"] Jun 03 14:02:27.324561 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.324542 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.331359 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.331334 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7dc5b6f4-qbcbc"] Jun 03 14:02:27.404335 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.404296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfwj6\" (UniqueName: \"kubernetes.io/projected/1a5c145c-5091-4b6a-ace8-873cae798329-kube-api-access-cfwj6\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.404521 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.404417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a5c145c-5091-4b6a-ace8-873cae798329-tls-cert\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.404521 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.404468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1a5c145c-5091-4b6a-ace8-873cae798329-oidc-ca\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.505753 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.505707 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a5c145c-5091-4b6a-ace8-873cae798329-tls-cert\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.505934 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.505795 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1a5c145c-5091-4b6a-ace8-873cae798329-oidc-ca\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.505934 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.505884 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfwj6\" (UniqueName: \"kubernetes.io/projected/1a5c145c-5091-4b6a-ace8-873cae798329-kube-api-access-cfwj6\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.506526 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.506501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1a5c145c-5091-4b6a-ace8-873cae798329-oidc-ca\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.508158 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.508132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a5c145c-5091-4b6a-ace8-873cae798329-tls-cert\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.515551 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.515527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfwj6\" (UniqueName: \"kubernetes.io/projected/1a5c145c-5091-4b6a-ace8-873cae798329-kube-api-access-cfwj6\") pod \"authorino-7c7dc5b6f4-qbcbc\" (UID: \"1a5c145c-5091-4b6a-ace8-873cae798329\") " pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.634771 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.634674 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" Jun 03 14:02:27.770078 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:27.770051 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7dc5b6f4-qbcbc"] Jun 03 14:02:27.772702 ip-10-0-139-48 kubenswrapper[2562]: W0603 14:02:27.772676 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a5c145c_5091_4b6a_ace8_873cae798329.slice/crio-7b8f963790828cb5d3f7da8c47600bd58273b53b6fe9aeff277e7bb9c67f2b33 WatchSource:0}: Error finding container 7b8f963790828cb5d3f7da8c47600bd58273b53b6fe9aeff277e7bb9c67f2b33: Status 404 returned error can't find the container with id 7b8f963790828cb5d3f7da8c47600bd58273b53b6fe9aeff277e7bb9c67f2b33 Jun 03 14:02:28.202165 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:28.202134 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" event={"ID":"1a5c145c-5091-4b6a-ace8-873cae798329","Type":"ContainerStarted","Data":"7b8f963790828cb5d3f7da8c47600bd58273b53b6fe9aeff277e7bb9c67f2b33"} Jun 03 14:02:29.214359 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.214322 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" event={"ID":"1a5c145c-5091-4b6a-ace8-873cae798329","Type":"ContainerStarted","Data":"91a1ad963d09511c331b011c239d5a316c53160493403778340c13ecc416f26b"} Jun 03 14:02:29.235032 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.234973 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7c7dc5b6f4-qbcbc" podStartSLOduration=1.802440498 podStartE2EDuration="2.234954244s" podCreationTimestamp="2026-06-03 14:02:27 +0000 UTC" firstStartedPulling="2026-06-03 14:02:27.774457731 +0000 UTC m=+890.386863029" lastFinishedPulling="2026-06-03 14:02:28.206971481 +0000 UTC m=+890.819376775" observedRunningTime="2026-06-03 14:02:29.232956248 +0000 UTC m=+891.845361567" watchObservedRunningTime="2026-06-03 14:02:29.234954244 +0000 UTC m=+891.847359560" Jun 03 14:02:29.264503 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.264469 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-767dccccd7-zqkl8"] Jun 03 14:02:29.264698 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.264677 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-767dccccd7-zqkl8" podUID="7d737398-1e69-4e9a-9544-97315d92d5ea" containerName="authorino" containerID="cri-o://48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551" gracePeriod=30 Jun 03 14:02:29.515034 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.515006 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 14:02:29.623404 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.623365 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d737398-1e69-4e9a-9544-97315d92d5ea-tls-cert\") pod \"7d737398-1e69-4e9a-9544-97315d92d5ea\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " Jun 03 14:02:29.623404 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.623409 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87pj4\" (UniqueName: \"kubernetes.io/projected/7d737398-1e69-4e9a-9544-97315d92d5ea-kube-api-access-87pj4\") pod \"7d737398-1e69-4e9a-9544-97315d92d5ea\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " Jun 03 14:02:29.623613 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.623456 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d737398-1e69-4e9a-9544-97315d92d5ea-oidc-ca\") pod \"7d737398-1e69-4e9a-9544-97315d92d5ea\" (UID: \"7d737398-1e69-4e9a-9544-97315d92d5ea\") " Jun 03 14:02:29.625507 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.625470 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d737398-1e69-4e9a-9544-97315d92d5ea-kube-api-access-87pj4" (OuterVolumeSpecName: "kube-api-access-87pj4") pod "7d737398-1e69-4e9a-9544-97315d92d5ea" (UID: "7d737398-1e69-4e9a-9544-97315d92d5ea"). InnerVolumeSpecName "kube-api-access-87pj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:02:29.628734 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.628702 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d737398-1e69-4e9a-9544-97315d92d5ea-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "7d737398-1e69-4e9a-9544-97315d92d5ea" (UID: "7d737398-1e69-4e9a-9544-97315d92d5ea"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:02:29.633763 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.633742 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d737398-1e69-4e9a-9544-97315d92d5ea-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7d737398-1e69-4e9a-9544-97315d92d5ea" (UID: "7d737398-1e69-4e9a-9544-97315d92d5ea"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:02:29.724839 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.724797 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d737398-1e69-4e9a-9544-97315d92d5ea-tls-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:02:29.724839 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.724832 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87pj4\" (UniqueName: \"kubernetes.io/projected/7d737398-1e69-4e9a-9544-97315d92d5ea-kube-api-access-87pj4\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:02:29.724839 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:29.724843 2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d737398-1e69-4e9a-9544-97315d92d5ea-oidc-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:02:30.219277 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.219210 2562 generic.go:358] "Generic (PLEG): container finished" podID="7d737398-1e69-4e9a-9544-97315d92d5ea" containerID="48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551" exitCode=0 Jun 03 14:02:30.219277 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.219280 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767dccccd7-zqkl8" Jun 03 14:02:30.219746 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.219294 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767dccccd7-zqkl8" event={"ID":"7d737398-1e69-4e9a-9544-97315d92d5ea","Type":"ContainerDied","Data":"48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551"} Jun 03 14:02:30.219746 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.219334 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767dccccd7-zqkl8" event={"ID":"7d737398-1e69-4e9a-9544-97315d92d5ea","Type":"ContainerDied","Data":"b23c9a1b2f1119d0d4bf870ef88234f77d26cbca4e562d27b5ca6b68b4b427c3"} Jun 03 14:02:30.219746 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.219350 2562 scope.go:117] "RemoveContainer" containerID="48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551" Jun 03 14:02:30.228277 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.228256 2562 scope.go:117] "RemoveContainer" containerID="48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551" Jun 03 14:02:30.228560 ip-10-0-139-48 kubenswrapper[2562]: E0603 14:02:30.228539 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551\": container with ID starting with 48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551 not found: ID does not exist" containerID="48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551" Jun 03 14:02:30.228623 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.228572 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551"} err="failed to get container status \"48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551\": rpc error: code = NotFound desc = could not find container \"48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551\": container with ID starting with 48424defc0347dc933aad674cdb6f92c43ade6271b3407bee30a1f97e010f551 not found: ID does not exist" Jun 03 14:02:30.235682 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.235652 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-767dccccd7-zqkl8"] Jun 03 14:02:30.237610 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:30.237583 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-767dccccd7-zqkl8"] Jun 03 14:02:31.999325 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:02:31.999291 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d737398-1e69-4e9a-9544-97315d92d5ea" path="/var/lib/kubelet/pods/7d737398-1e69-4e9a-9544-97315d92d5ea/volumes" Jun 03 14:03:03.195809 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:03:03.195733 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:03:13.502377 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:03:13.502340 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:03:23.204042 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:03:23.203999 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:03:32.202419 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:03:32.202378 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:03:41.003236 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:03:41.003194 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:03:51.707002 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:03:51.706962 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:05:05.407521 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:05:05.407485 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:05:21.197979 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:05:21.197937 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:05:59.804884 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:05:59.804846 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:06:16.324709 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:06:16.324652 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:06:32.008476 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:06:32.008439 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:06:49.005522 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:06:49.005484 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:07:43.303914 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:07:43.303876 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:07:52.706755 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:07:52.706712 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:08:09.006129 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:08:09.006095 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:08:18.513317 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:08:18.513276 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:08:34.110665 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:08:34.110625 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:08:43.003662 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:08:43.003620 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:09:15.611187 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:09:15.611151 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:09:23.714763 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:09:23.714718 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:09:32.304746 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:09:32.304711 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:09:40.000679 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:09:40.000648 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:09:49.202336 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:09:49.202298 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:10:05.115480 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:10:05.115398 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:10:20.010051 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:10:20.010017 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:11:08.604700 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:11:08.604661 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:11:15.611880 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:11:15.611836 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:11:21.400746 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:11:21.400705 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:11:30.202017 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:11:30.201937 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:11:38.902746 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:11:38.902712 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:11:47.808650 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:11:47.808604 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:11:56.609109 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:11:56.609069 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:12:03.305873 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:12:03.305832 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:12:13.309866 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:12:13.309823 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:12:22.511417 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:12:22.511372 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:12:31.022131 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:12:31.022092 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:12:40.815059 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:12:40.815022 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:12:49.362527 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:12:49.362493 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:12:56.708040 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:12:56.707952 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:13:04.812839 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:13:04.812798 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:13:15.011514 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:13:15.011473 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:13:24.307928 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:13:24.307886 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:13:30.903580 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:13:30.903538 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:15:25.551977 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.551939 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fb687467-dlx2b"] Jun 03 14:15:25.552533 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.552417 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d737398-1e69-4e9a-9544-97315d92d5ea" containerName="authorino" Jun 03 14:15:25.552533 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.552430 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d737398-1e69-4e9a-9544-97315d92d5ea" containerName="authorino" Jun 03 14:15:25.552533 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.552499 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d737398-1e69-4e9a-9544-97315d92d5ea" containerName="authorino" Jun 03 14:15:25.554632 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.554612 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.568058 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.568031 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fb687467-dlx2b"] Jun 03 14:15:25.596780 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.596746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxpsj\" (UniqueName: \"kubernetes.io/projected/405a8bd4-aef0-4b04-accd-700cd6d132e9-kube-api-access-dxpsj\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.596934 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.596793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-config\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.596934 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.596873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-service-ca\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.596934 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.596910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-oauth-serving-cert\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.597041 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.596935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-trusted-ca-bundle\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.597041 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.596959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-oauth-config\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.597041 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.597017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-serving-cert\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.697804 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.697746 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-serving-cert\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698018 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.697857 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxpsj\" (UniqueName: \"kubernetes.io/projected/405a8bd4-aef0-4b04-accd-700cd6d132e9-kube-api-access-dxpsj\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698018 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.697900 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-config\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698018 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.697953 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-service-ca\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698018 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.697982 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-oauth-serving-cert\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698018 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.698015 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-trusted-ca-bundle\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698338 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.698042 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-oauth-config\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698717 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.698690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-config\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698820 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.698773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-oauth-serving-cert\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698820 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.698791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-service-ca\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.698974 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.698952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405a8bd4-aef0-4b04-accd-700cd6d132e9-trusted-ca-bundle\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.700450 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.700426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-oauth-config\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.700540 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.700527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/405a8bd4-aef0-4b04-accd-700cd6d132e9-console-serving-cert\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.706143 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.706125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxpsj\" (UniqueName: \"kubernetes.io/projected/405a8bd4-aef0-4b04-accd-700cd6d132e9-kube-api-access-dxpsj\") pod \"console-54fb687467-dlx2b\" (UID: \"405a8bd4-aef0-4b04-accd-700cd6d132e9\") " pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:25.864264 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:25.864153 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:26.002398 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:26.002290 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fb687467-dlx2b"] Jun 03 14:15:26.004858 ip-10-0-139-48 kubenswrapper[2562]: W0603 14:15:26.004830 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405a8bd4_aef0_4b04_accd_700cd6d132e9.slice/crio-6c7a74a70134f5ea1de6958121315bf30d580e078c954a1d7fc972a9a7e233b9 WatchSource:0}: Error finding container 6c7a74a70134f5ea1de6958121315bf30d580e078c954a1d7fc972a9a7e233b9: Status 404 returned error can't find the container with id 6c7a74a70134f5ea1de6958121315bf30d580e078c954a1d7fc972a9a7e233b9 Jun 03 14:15:26.007030 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:26.007012 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:15:26.998034 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:26.998005 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fb687467-dlx2b" event={"ID":"405a8bd4-aef0-4b04-accd-700cd6d132e9","Type":"ContainerStarted","Data":"22ecf9b9600e4f8be43b9853096cccb06ac1acb0335f0bf787c1f4e7d4db0633"} Jun 03 14:15:26.998034 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:26.998038 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fb687467-dlx2b" event={"ID":"405a8bd4-aef0-4b04-accd-700cd6d132e9","Type":"ContainerStarted","Data":"6c7a74a70134f5ea1de6958121315bf30d580e078c954a1d7fc972a9a7e233b9"} Jun 03 14:15:27.018109 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:27.018055 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-54fb687467-dlx2b" podStartSLOduration=2.018039329 podStartE2EDuration="2.018039329s" podCreationTimestamp="2026-06-03 14:15:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:15:27.01683394 +0000 UTC m=+1669.629239249" watchObservedRunningTime="2026-06-03 14:15:27.018039329 +0000 UTC m=+1669.630444645" Jun 03 14:15:35.864980 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:35.864935 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:35.864980 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:35.864986 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:35.870280 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:35.870252 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:36.040890 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:36.040855 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54fb687467-dlx2b" Jun 03 14:15:36.098126 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:36.098093 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86698bcc4d-nl6vr"] Jun 03 14:15:48.798993 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:48.798952 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:15:55.204892 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:15:55.204800 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:16:01.126023 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.125968 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-86698bcc4d-nl6vr" podUID="deb50de5-5f8c-4489-8f4c-199feb9edc8c" containerName="console" containerID="cri-o://79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49" gracePeriod=15 Jun 03 14:16:01.375868 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.375843 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86698bcc4d-nl6vr_deb50de5-5f8c-4489-8f4c-199feb9edc8c/console/0.log" Jun 03 14:16:01.375995 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.375908 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 14:16:01.444628 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.444591 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-oauth-config\") pod \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " Jun 03 14:16:01.444819 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.444657 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-trusted-ca-bundle\") pod \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " Jun 03 14:16:01.444880 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.444805 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-oauth-serving-cert\") pod \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " Jun 03 14:16:01.444880 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.444863 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-service-ca\") pod \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " Jun 03 14:16:01.444986 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.444934 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztqw8\" (UniqueName: \"kubernetes.io/projected/deb50de5-5f8c-4489-8f4c-199feb9edc8c-kube-api-access-ztqw8\") pod \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " Jun 03 14:16:01.444986 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.444972 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-config\") pod \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " Jun 03 14:16:01.445092 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445046 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-serving-cert\") pod \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\" (UID: \"deb50de5-5f8c-4489-8f4c-199feb9edc8c\") " Jun 03 14:16:01.445168 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445135 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "deb50de5-5f8c-4489-8f4c-199feb9edc8c" (UID: "deb50de5-5f8c-4489-8f4c-199feb9edc8c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:16:01.445296 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445272 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "deb50de5-5f8c-4489-8f4c-199feb9edc8c" (UID: "deb50de5-5f8c-4489-8f4c-199feb9edc8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:16:01.445397 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445375 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "deb50de5-5f8c-4489-8f4c-199feb9edc8c" (UID: "deb50de5-5f8c-4489-8f4c-199feb9edc8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:16:01.445469 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445419 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-config" (OuterVolumeSpecName: "console-config") pod "deb50de5-5f8c-4489-8f4c-199feb9edc8c" (UID: "deb50de5-5f8c-4489-8f4c-199feb9edc8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:16:01.445524 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445513 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-trusted-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:16:01.445580 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445533 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-oauth-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:16:01.445580 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445548 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:16:01.445580 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.445562 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:16:01.447257 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.447207 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "deb50de5-5f8c-4489-8f4c-199feb9edc8c" (UID: "deb50de5-5f8c-4489-8f4c-199feb9edc8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:16:01.447432 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.447272 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "deb50de5-5f8c-4489-8f4c-199feb9edc8c" (UID: "deb50de5-5f8c-4489-8f4c-199feb9edc8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:16:01.447432 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.447272 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb50de5-5f8c-4489-8f4c-199feb9edc8c-kube-api-access-ztqw8" (OuterVolumeSpecName: "kube-api-access-ztqw8") pod "deb50de5-5f8c-4489-8f4c-199feb9edc8c" (UID: "deb50de5-5f8c-4489-8f4c-199feb9edc8c"). InnerVolumeSpecName "kube-api-access-ztqw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:16:01.547060 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.547017 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztqw8\" (UniqueName: \"kubernetes.io/projected/deb50de5-5f8c-4489-8f4c-199feb9edc8c-kube-api-access-ztqw8\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:16:01.547060 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.547053 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:16:01.547060 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:01.547063 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deb50de5-5f8c-4489-8f4c-199feb9edc8c-console-oauth-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\"" Jun 03 14:16:02.132151 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.132122 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86698bcc4d-nl6vr_deb50de5-5f8c-4489-8f4c-199feb9edc8c/console/0.log" Jun 03 14:16:02.132588 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.132164 2562 generic.go:358] "Generic (PLEG): container finished" podID="deb50de5-5f8c-4489-8f4c-199feb9edc8c" containerID="79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49" exitCode=2 Jun 03 14:16:02.132588 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.132263 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86698bcc4d-nl6vr" event={"ID":"deb50de5-5f8c-4489-8f4c-199feb9edc8c","Type":"ContainerDied","Data":"79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49"} Jun 03 14:16:02.132588 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.132284 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86698bcc4d-nl6vr" Jun 03 14:16:02.132588 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.132305 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86698bcc4d-nl6vr" event={"ID":"deb50de5-5f8c-4489-8f4c-199feb9edc8c","Type":"ContainerDied","Data":"e631723cba63dbfbf0e44e2981eecdc93958fa5e8b7da7a9f6a0d9775c785c09"} Jun 03 14:16:02.132588 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.132321 2562 scope.go:117] "RemoveContainer" containerID="79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49" Jun 03 14:16:02.141093 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.141072 2562 scope.go:117] "RemoveContainer" containerID="79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49" Jun 03 14:16:02.141397 ip-10-0-139-48 kubenswrapper[2562]: E0603 14:16:02.141377 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49\": container with ID starting with 79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49 not found: ID does not exist" containerID="79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49" Jun 03 14:16:02.141456 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.141406 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49"} err="failed to get container status \"79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49\": rpc error: code = NotFound desc = could not find container \"79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49\": container with ID starting with 79c6403b1e5b0be542059d47a3df806990d236300c01deff5ac92e1ad83cbd49 not found: ID does not exist" Jun 03 14:16:02.152469 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.152437 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86698bcc4d-nl6vr"] Jun 03 14:16:02.159112 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:02.159081 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86698bcc4d-nl6vr"] Jun 03 14:16:03.999803 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:03.999769 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb50de5-5f8c-4489-8f4c-199feb9edc8c" path="/var/lib/kubelet/pods/deb50de5-5f8c-4489-8f4c-199feb9edc8c/volumes" Jun 03 14:16:20.107515 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:20.107475 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:16:26.527430 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:26.527391 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:16:37.420278 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:37.416991 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:16:46.309329 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:46.309290 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:16:56.616188 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:16:56.616146 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:17:07.313174 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:17:07.313129 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:17:15.933848 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:17:15.933809 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:17:26.615969 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:17:26.615856 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:17:34.913263 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:17:34.913208 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:17:45.810501 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:17:45.810441 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:17:54.220012 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:17:54.219972 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:18:29.408687 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:18:29.408650 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:19:12.303077 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:19:12.302987 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:19:21.322757 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:19:21.322715 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:19:29.837098 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:19:29.837053 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:19:39.196847 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:19:39.196801 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:19:46.000851 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:19:46.000819 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:20:00.199900 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:20:00.199860 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:20:08.316345 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:20:08.316313 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:20:19.499635 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:20:19.499593 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:20:28.427445 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:20:28.422575 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:20:34.727079 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:20:34.727042 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:20:45.116093 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:20:45.116052 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:20:56.995296 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:20:56.995256 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:21:14.306664 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:21:14.306622 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:21:21.616851 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:21:21.616808 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:21:32.038407 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:21:32.038361 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:21:40.712650 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:21:40.712608 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:21:57.906114 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:21:57.906033 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:22:06.105232 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:22:06.105184 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:22:15.109486 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:22:15.109440 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:22:21.917162 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:22:21.917125 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:22:32.305263 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:22:32.305210 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:22:39.010889 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:22:39.010853 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:22:49.506700 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:22:49.506657 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:23:01.607141 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:23:01.607101 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:23:12.135740 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:23:12.135691 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:23:24.919213 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:23:24.919130 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:23:33.512773 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:23:33.512730 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:23:44.253972 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:23:44.253933 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:23:52.814705 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:23:52.814661 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:24:03.632514 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:24:03.632478 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:24:19.805120 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:24:19.805084 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:24:28.910755 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:24:28.910713 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:24:35.412342 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:24:35.412299 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:24:44.000291 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:24:44.000261 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:24:53.110082 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:24:53.110047 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:25:13.619555 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:13.619476 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:25:25.503343 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:25.503301 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-2bbr6"] Jun 03 14:25:30.778517 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:30.778486 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7dc5b6f4-qbcbc_1a5c145c-5091-4b6a-ace8-873cae798329/authorino/0.log" Jun 03 14:25:35.846765 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:35.846729 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-84c5cc9c76-8qmqp_161eec19-1813-4519-a7e4-0e712e868cc1/maas-api/0.log" Jun 03 14:25:36.774121 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:36.774056 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5496d4666c-glwjp_d5e27e2e-4ff1-44bd-a9c6-ebce2054749e/manager/0.log" Jun 03 14:25:36.782149 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:36.782129 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5496d4666c-glwjp_d5e27e2e-4ff1-44bd-a9c6-ebce2054749e/copy-manifests/0.log" Jun 03 14:25:38.184379 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:38.184350 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7dc5b6f4-qbcbc_1a5c145c-5091-4b6a-ace8-873cae798329/authorino/0.log" Jun 03 14:25:38.433213 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:38.433184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-562ns_e0d07663-734a-463a-bd6f-6db3a2aad7d4/manager/0.log" Jun 03 14:25:38.908178 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:38.908149 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-2bbr6_ff70957f-b6d9-4135-8056-a19a6754b487/limitador/0.log" Jun 03 14:25:39.024316 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:39.024266 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kbsnd_188b5442-fa85-4f3e-96fc-100146d95abb/manager/0.log" Jun 03 14:25:39.605016 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:39.604989 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-854c9b8647-gxsn4_c0919bc5-5232-41a5-9a96-c45a07e2b757/kube-auth-proxy/0.log" Jun 03 14:25:41.006155 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:41.006113 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t_997b5f91-df5b-4438-b6a6-abc5aacef3de/storage-initializer/0.log" Jun 03 14:25:41.012702 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:41.012664 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s72t_997b5f91-df5b-4438-b6a6-abc5aacef3de/main/0.log" Jun 03 14:25:45.581406 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.581370 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wb4xx/must-gather-jsb5j"] Jun 03 14:25:45.581807 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.581793 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb50de5-5f8c-4489-8f4c-199feb9edc8c" containerName="console" Jun 03 14:25:45.581851 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.581809 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb50de5-5f8c-4489-8f4c-199feb9edc8c" containerName="console" Jun 03 14:25:45.581886 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.581879 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="deb50de5-5f8c-4489-8f4c-199feb9edc8c" containerName="console" Jun 03 14:25:45.585123 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.585102 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:45.588267 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.588240 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wb4xx\"/\"kube-root-ca.crt\"" Jun 03 14:25:45.588267 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.588250 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wb4xx\"/\"openshift-service-ca.crt\"" Jun 03 14:25:45.589287 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.589265 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wb4xx\"/\"default-dockercfg-nhtth\"" Jun 03 14:25:45.602476 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.602443 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb4xx/must-gather-jsb5j"] Jun 03 14:25:45.638901 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.638862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7950a211-520b-4853-a513-4f452595a23a-must-gather-output\") pod \"must-gather-jsb5j\" (UID: \"7950a211-520b-4853-a513-4f452595a23a\") " pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:45.638901 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.638909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7n8\" (UniqueName: \"kubernetes.io/projected/7950a211-520b-4853-a513-4f452595a23a-kube-api-access-ff7n8\") pod \"must-gather-jsb5j\" (UID: \"7950a211-520b-4853-a513-4f452595a23a\") " pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:45.740279 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.740233 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7950a211-520b-4853-a513-4f452595a23a-must-gather-output\") pod \"must-gather-jsb5j\" (UID: \"7950a211-520b-4853-a513-4f452595a23a\") " pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:45.740279 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.740283 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7n8\" (UniqueName: \"kubernetes.io/projected/7950a211-520b-4853-a513-4f452595a23a-kube-api-access-ff7n8\") pod \"must-gather-jsb5j\" (UID: \"7950a211-520b-4853-a513-4f452595a23a\") " pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:45.740577 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.740554 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7950a211-520b-4853-a513-4f452595a23a-must-gather-output\") pod \"must-gather-jsb5j\" (UID: \"7950a211-520b-4853-a513-4f452595a23a\") " pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:45.751780 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.751745 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7n8\" (UniqueName: \"kubernetes.io/projected/7950a211-520b-4853-a513-4f452595a23a-kube-api-access-ff7n8\") pod \"must-gather-jsb5j\" (UID: \"7950a211-520b-4853-a513-4f452595a23a\") " pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:45.894244 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:45.894133 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb4xx/must-gather-jsb5j" Jun 03 14:25:46.030257 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:46.030232 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb4xx/must-gather-jsb5j"] Jun 03 14:25:46.032549 ip-10-0-139-48 kubenswrapper[2562]: W0603 14:25:46.032512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7950a211_520b_4853_a513_4f452595a23a.slice/crio-115a628be2ccac9bc8e3c489a894a6c1a65f4a08d9c48b02d7c0be67e4dade6b WatchSource:0}: Error finding container 115a628be2ccac9bc8e3c489a894a6c1a65f4a08d9c48b02d7c0be67e4dade6b: Status 404 returned error can't find the container with id 115a628be2ccac9bc8e3c489a894a6c1a65f4a08d9c48b02d7c0be67e4dade6b Jun 03 14:25:46.034168 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:46.034151 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:25:46.224002 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:46.223966 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb4xx/must-gather-jsb5j" event={"ID":"7950a211-520b-4853-a513-4f452595a23a","Type":"ContainerStarted","Data":"115a628be2ccac9bc8e3c489a894a6c1a65f4a08d9c48b02d7c0be67e4dade6b"} Jun 03 14:25:47.230425 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:47.230390 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb4xx/must-gather-jsb5j" event={"ID":"7950a211-520b-4853-a513-4f452595a23a","Type":"ContainerStarted","Data":"415db1b236abfdd9c878622905809e897ff1401ea172585cdd59ddaf87e4da9a"} Jun 03 14:25:47.230832 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:47.230433 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb4xx/must-gather-jsb5j" event={"ID":"7950a211-520b-4853-a513-4f452595a23a","Type":"ContainerStarted","Data":"76eeb1820af09fb3cbfd75f3831964601d8d22265bf78ad0a55a7789438595b4"} Jun 03 14:25:47.254443 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:47.254390 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wb4xx/must-gather-jsb5j" podStartSLOduration=1.618289114 podStartE2EDuration="2.254374287s" podCreationTimestamp="2026-06-03 14:25:45 +0000 UTC" firstStartedPulling="2026-06-03 14:25:46.03430205 +0000 UTC m=+2288.646707344" lastFinishedPulling="2026-06-03 14:25:46.670387219 +0000 UTC m=+2289.282792517" observedRunningTime="2026-06-03 14:25:47.251469501 +0000 UTC m=+2289.863874817" watchObservedRunningTime="2026-06-03 14:25:47.254374287 +0000 UTC m=+2289.866779602" Jun 03 14:25:48.670498 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:48.670458 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8mb6n_c48c289d-5be8-4f5f-8c72-7b1677abe972/global-pull-secret-syncer/0.log" Jun 03 14:25:48.882456 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:48.882422 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xdfnh_b3c9fb08-cc1a-47b5-9dda-81d54bab8b50/konnectivity-agent/0.log" Jun 03 14:25:48.931302 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:48.931208 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-48.ec2.internal_a38671be153c2d4d2220cadc6bb89d3b/haproxy/0.log" Jun 03 14:25:53.449100 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:53.449051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7dc5b6f4-qbcbc_1a5c145c-5091-4b6a-ace8-873cae798329/authorino/0.log" Jun 03 14:25:53.513303 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:53.513269 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-562ns_e0d07663-734a-463a-bd6f-6db3a2aad7d4/manager/0.log" Jun 03 14:25:53.695583 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:53.695539 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-2bbr6_ff70957f-b6d9-4135-8056-a19a6754b487/limitador/0.log" Jun 03 14:25:53.768972 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:53.768927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kbsnd_188b5442-fa85-4f3e-96fc-100146d95abb/manager/0.log" Jun 03 14:25:55.077597 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.077559 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b8aedd4-7454-4f7b-92db-68b57c001b8a/alertmanager/0.log" Jun 03 14:25:55.107021 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.106985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b8aedd4-7454-4f7b-92db-68b57c001b8a/config-reloader/0.log" Jun 03 14:25:55.131828 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.131792 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b8aedd4-7454-4f7b-92db-68b57c001b8a/kube-rbac-proxy-web/0.log" Jun 03 14:25:55.167578 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.167530 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b8aedd4-7454-4f7b-92db-68b57c001b8a/kube-rbac-proxy/0.log" Jun 03 14:25:55.197428 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.197399 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b8aedd4-7454-4f7b-92db-68b57c001b8a/kube-rbac-proxy-metric/0.log" Jun 03 14:25:55.222106 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.222081 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b8aedd4-7454-4f7b-92db-68b57c001b8a/prom-label-proxy/0.log" Jun 03 14:25:55.249699 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.249671 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b8aedd4-7454-4f7b-92db-68b57c001b8a/init-config-reloader/0.log" Jun 03 14:25:55.324321 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.324199 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mqzpc_829b0fc4-75f8-48f6-b1d3-a75ee61122c8/kube-state-metrics/0.log" Jun 03 14:25:55.348012 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.347976 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mqzpc_829b0fc4-75f8-48f6-b1d3-a75ee61122c8/kube-rbac-proxy-main/0.log" Jun 03 14:25:55.376871 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.376839 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mqzpc_829b0fc4-75f8-48f6-b1d3-a75ee61122c8/kube-rbac-proxy-self/0.log" Jun 03 14:25:55.422384 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.422318 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8f678b84d-j4qb2_2c158d2f-f174-4b7b-bf1d-4ad92bb94c6a/metrics-server/0.log" Jun 03 14:25:55.468708 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.468674 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-n5r6c_fb1aad32-2948-46a2-822f-5eaa940e717d/monitoring-plugin/0.log" Jun 03 14:25:55.619367 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.619268 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxnnt_7d1aa2df-2056-4d16-b5b1-0a59162fdbe7/node-exporter/0.log" Jun 03 14:25:55.647153 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.647130 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxnnt_7d1aa2df-2056-4d16-b5b1-0a59162fdbe7/kube-rbac-proxy/0.log" Jun 03 14:25:55.676313 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.676233 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxnnt_7d1aa2df-2056-4d16-b5b1-0a59162fdbe7/init-textfile/0.log" Jun 03 14:25:55.784471 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.784389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7z4mz_4a8d5f0f-8233-4226-bcbb-8328dae39888/kube-rbac-proxy-main/0.log" Jun 03 14:25:55.810864 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.810782 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7z4mz_4a8d5f0f-8233-4226-bcbb-8328dae39888/kube-rbac-proxy-self/0.log" Jun 03 14:25:55.835563 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.835506 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7z4mz_4a8d5f0f-8233-4226-bcbb-8328dae39888/openshift-state-metrics/0.log" Jun 03 14:25:55.875272 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.875184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98bbbfef-45ed-49ed-8d2d-7be2334b654b/prometheus/0.log" Jun 03 14:25:55.904290 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.904262 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98bbbfef-45ed-49ed-8d2d-7be2334b654b/config-reloader/0.log" Jun 03 14:25:55.926694 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.926664 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98bbbfef-45ed-49ed-8d2d-7be2334b654b/thanos-sidecar/0.log" Jun 03 14:25:55.950646 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.950600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98bbbfef-45ed-49ed-8d2d-7be2334b654b/kube-rbac-proxy-web/0.log" Jun 03 14:25:55.974636 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:55.974585 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98bbbfef-45ed-49ed-8d2d-7be2334b654b/kube-rbac-proxy/0.log" Jun 03 14:25:56.002804 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.002710 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98bbbfef-45ed-49ed-8d2d-7be2334b654b/kube-rbac-proxy-thanos/0.log" Jun 03 14:25:56.022814 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.022788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98bbbfef-45ed-49ed-8d2d-7be2334b654b/init-config-reloader/0.log" Jun 03 14:25:56.065409 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.065377 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-jl5hj_f969aa61-179f-4dec-883a-78786dd5f7e9/prometheus-operator/0.log" Jun 03 14:25:56.088800 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.088768 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-jl5hj_f969aa61-179f-4dec-883a-78786dd5f7e9/kube-rbac-proxy/0.log" Jun 03 14:25:56.114849 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.114821 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-sbfmr_72493099-ac7f-4b1e-a0f9-b4ef2d901fdb/prometheus-operator-admission-webhook/0.log" Jun 03 14:25:56.150019 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.149985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f97b45f58-b6jfg_8c98603e-f86a-4df9-b35b-b0f6524933db/telemeter-client/0.log" Jun 03 14:25:56.174435 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.174400 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f97b45f58-b6jfg_8c98603e-f86a-4df9-b35b-b0f6524933db/reload/0.log" Jun 03 14:25:56.196981 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.196954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f97b45f58-b6jfg_8c98603e-f86a-4df9-b35b-b0f6524933db/kube-rbac-proxy/0.log" Jun 03 14:25:56.237612 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.237580 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96546579b-n89t2_eddcbf42-ab96-4bbc-81b0-a9c5e50b691b/thanos-query/0.log" Jun 03 14:25:56.259976 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.259834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96546579b-n89t2_eddcbf42-ab96-4bbc-81b0-a9c5e50b691b/kube-rbac-proxy-web/0.log" Jun 03 14:25:56.281410 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.281365 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96546579b-n89t2_eddcbf42-ab96-4bbc-81b0-a9c5e50b691b/kube-rbac-proxy/0.log" Jun 03 14:25:56.302515 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.302487 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96546579b-n89t2_eddcbf42-ab96-4bbc-81b0-a9c5e50b691b/prom-label-proxy/0.log" Jun 03 14:25:56.325002 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.324971 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96546579b-n89t2_eddcbf42-ab96-4bbc-81b0-a9c5e50b691b/kube-rbac-proxy-rules/0.log" Jun 03 14:25:56.348664 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:56.348628 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96546579b-n89t2_eddcbf42-ab96-4bbc-81b0-a9c5e50b691b/kube-rbac-proxy-metrics/0.log" Jun 03 14:25:58.554524 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:58.554473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54fb687467-dlx2b_405a8bd4-aef0-4b04-accd-700cd6d132e9/console/0.log" Jun 03 14:25:59.799911 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.799861 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k"] Jun 03 14:25:59.803870 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.803849 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:25:59.809512 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.809483 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k"] Jun 03 14:25:59.905379 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.905345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-podres\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:25:59.905563 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.905430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-proc\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:25:59.905563 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.905500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-lib-modules\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:25:59.905653 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.905613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ww7k\" (UniqueName: \"kubernetes.io/projected/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-kube-api-access-8ww7k\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:25:59.905700 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:25:59.905669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-sys\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.006791 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.006740 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ww7k\" (UniqueName: \"kubernetes.io/projected/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-kube-api-access-8ww7k\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007003 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.006819 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-sys\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007003 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.006862 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-podres\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007003 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.006891 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-proc\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007003 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.006945 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-lib-modules\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007191 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.007169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-lib-modules\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007421 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.007383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-proc\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007549 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.007310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-podres\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.007549 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.007247 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-sys\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.015857 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.015828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ww7k\" (UniqueName: \"kubernetes.io/projected/2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156-kube-api-access-8ww7k\") pod \"perf-node-gather-daemonset-hw97k\" (UID: \"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156\") " pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.116091 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.116014 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:00.145839 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.145790 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtx25_d8210414-9d84-4e6d-86f9-bc8f6499ea52/dns/0.log" Jun 03 14:26:00.170847 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.170823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtx25_d8210414-9d84-4e6d-86f9-bc8f6499ea52/kube-rbac-proxy/0.log" Jun 03 14:26:00.255409 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.255373 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jkfbn_38dfa819-7f03-4637-887f-646826424ca2/dns-node-resolver/0.log" Jun 03 14:26:00.256982 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.256959 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k"] Jun 03 14:26:00.302175 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.302136 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" event={"ID":"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156","Type":"ContainerStarted","Data":"851ebe0d31b0b50ad55418adcb6ff040f782d23e9da483882301b056351333a6"} Jun 03 14:26:00.919142 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:00.919111 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2lrw_109bad97-7fca-48bb-8f96-b96090b30407/node-ca/0.log" Jun 03 14:26:01.306818 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:01.306734 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" event={"ID":"2e6637b9-e94e-41eb-bbc3-0fd0b3ee2156","Type":"ContainerStarted","Data":"6140f9992dc3cbc1e03764b44437c8959036f55a57d3767e06dd5f2c23ea9639"} Jun 03 14:26:01.306978 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:01.306859 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:01.325384 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:01.325319 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" podStartSLOduration=2.3252987 podStartE2EDuration="2.3252987s" podCreationTimestamp="2026-06-03 14:25:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:26:01.322930826 +0000 UTC m=+2303.935336142" watchObservedRunningTime="2026-06-03 14:26:01.3252987 +0000 UTC m=+2303.937704018" Jun 03 14:26:01.979440 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:01.979409 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-854c9b8647-gxsn4_c0919bc5-5232-41a5-9a96-c45a07e2b757/kube-auth-proxy/0.log" Jun 03 14:26:02.688772 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:02.688742 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dgd9_47a1b9f5-a619-4a89-9b53-b0fd590813f2/serve-healthcheck-canary/0.log" Jun 03 14:26:03.379529 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:03.379487 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj58t_d6f5d5c4-45eb-48fa-962a-c873f5f7bd51/kube-rbac-proxy/0.log" Jun 03 14:26:03.402434 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:03.402399 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj58t_d6f5d5c4-45eb-48fa-962a-c873f5f7bd51/exporter/0.log" Jun 03 14:26:03.425781 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:03.425752 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj58t_d6f5d5c4-45eb-48fa-962a-c873f5f7bd51/extractor/0.log" Jun 03 14:26:05.791628 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:05.791578 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-84c5cc9c76-8qmqp_161eec19-1813-4519-a7e4-0e712e868cc1/maas-api/0.log" Jun 03 14:26:06.274736 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:06.274698 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5496d4666c-glwjp_d5e27e2e-4ff1-44bd-a9c6-ebce2054749e/manager/0.log" Jun 03 14:26:06.302831 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:06.302804 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5496d4666c-glwjp_d5e27e2e-4ff1-44bd-a9c6-ebce2054749e/copy-manifests/0.log" Jun 03 14:26:07.322449 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:07.322421 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wb4xx/perf-node-gather-daemonset-hw97k" Jun 03 14:26:07.695259 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:07.695212 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-759cc9b955-d7hw8_7447ad98-8786-4d2f-924c-939b03b0119e/manager/0.log" Jun 03 14:26:07.757660 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:07.757621 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-c29pk_bf8e7e19-8a9c-448a-987d-f6202423432b/openshift-lws-operator/0.log" Jun 03 14:26:14.346390 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.346363 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vgdg_08e644be-d8f1-4da3-8547-4d189c45819f/kube-multus-additional-cni-plugins/0.log" Jun 03 14:26:14.370158 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.370127 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vgdg_08e644be-d8f1-4da3-8547-4d189c45819f/egress-router-binary-copy/0.log" Jun 03 14:26:14.392921 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.392896 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vgdg_08e644be-d8f1-4da3-8547-4d189c45819f/cni-plugins/0.log" Jun 03 14:26:14.413529 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.413503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vgdg_08e644be-d8f1-4da3-8547-4d189c45819f/bond-cni-plugin/0.log" Jun 03 14:26:14.439398 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.439362 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vgdg_08e644be-d8f1-4da3-8547-4d189c45819f/routeoverride-cni/0.log" Jun 03 14:26:14.465998 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.465973 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vgdg_08e644be-d8f1-4da3-8547-4d189c45819f/whereabouts-cni-bincopy/0.log" Jun 03 14:26:14.487763 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.487735 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vgdg_08e644be-d8f1-4da3-8547-4d189c45819f/whereabouts-cni/0.log" Jun 03 14:26:14.919467 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:14.919440 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pdhlf_eeadb40e-34f6-4b31-98d1-84c1b0680f33/kube-multus/0.log" Jun 03 14:26:15.107199 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:15.107165 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tcn5x_1f95aa13-89ff-4764-80e3-ba2701e0d364/network-metrics-daemon/0.log" Jun 03 14:26:15.134027 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:15.133999 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tcn5x_1f95aa13-89ff-4764-80e3-ba2701e0d364/kube-rbac-proxy/0.log" Jun 03 14:26:16.748826 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:16.748723 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/ovn-controller/0.log" Jun 03 14:26:16.779632 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:16.779603 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/ovn-acl-logging/0.log" Jun 03 14:26:16.797370 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:16.797335 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/kube-rbac-proxy-node/0.log" Jun 03 14:26:16.818621 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:16.818589 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 14:26:16.840803 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:16.840761 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/northd/0.log" Jun 03 14:26:16.865929 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:16.865892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/nbdb/0.log" Jun 03 14:26:16.888418 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:16.888379 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/sbdb/0.log" Jun 03 14:26:17.011160 ip-10-0-139-48 kubenswrapper[2562]: I0603 14:26:17.011069 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nngck_4b8ba6fb-bc6e-4cba-a402-7db8544da6fb/ovnkube-controller/0.log"