Sep 17 17:41:08.663406 ip-10-0-142-71 systemd[1]: Starting Kubernetes Kubelet... Sep 17 17:41:12.097649 ip-10-0-142-71 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:41:12.097649 ip-10-0-142-71 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 17:41:12.097649 ip-10-0-142-71 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:41:12.097649 ip-10-0-142-71 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 17:41:12.097649 ip-10-0-142-71 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:41:12.098790 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.097740 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 17:41:12.100837 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100808 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:41:12.100837 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100836 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100841 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100845 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100848 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100851 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100853 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100856 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100859 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100862 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100899 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100902 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100905 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100908 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100912 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100916 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100919 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100922 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100925 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:41:12.100918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100928 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100931 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100934 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100937 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100939 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100942 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100945 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100948 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100950 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100953 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100956 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100959 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100962 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100964 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100967 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100969 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100972 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100975 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100977 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100980 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:41:12.101365 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100982 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100985 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100987 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100990 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100992 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100995 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.100997 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101000 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101002 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101018 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101020 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101023 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101025 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101028 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101032 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101037 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101041 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101045 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101048 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:41:12.101845 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101051 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101054 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101058 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101061 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101066 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101068 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101071 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101073 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101076 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101079 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101082 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101085 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101087 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101090 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101093 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101095 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101098 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101100 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101103 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101106 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:41:12.102322 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101109 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101111 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101114 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101116 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101119 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101121 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101123 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101128 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101131 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101134 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101140 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101143 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101146 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101149 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101151 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101154 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101157 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101160 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101163 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:41:12.102854 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101165 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101168 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101888 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101896 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101899 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101902 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101905 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101907 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101910 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101913 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101915 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101918 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101922 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101924 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101927 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101930 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101933 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101936 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101939 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101941 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:41:12.103572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101945 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101948 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101951 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101953 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101956 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101959 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101961 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101964 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101967 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101970 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101972 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101975 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101977 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101980 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101983 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101986 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101989 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101992 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101995 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.101997 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:41:12.104357 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102000 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102002 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102019 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102022 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102026 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102029 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102032 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102035 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102037 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102040 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102042 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102045 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102049 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102051 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102054 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102056 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102059 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102061 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102065 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102067 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:41:12.105211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102070 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102073 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102075 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102078 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102081 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102083 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102086 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102089 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102092 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102095 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102097 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102100 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102102 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102105 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102108 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102110 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102116 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102120 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102124 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:41:12.105809 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102127 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102130 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102133 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102136 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102139 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102142 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102145 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102147 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102150 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102153 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102155 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102158 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102162 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102165 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102168 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102171 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102174 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102177 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102180 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:41:12.106381 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102183 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102185 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102192 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102853 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102886 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102893 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102898 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102903 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102910 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102917 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102922 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102927 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102933 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102938 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102942 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102947 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102955 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102960 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102966 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:41:12.106885 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102971 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102975 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102980 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102986 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102990 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102994 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.102999 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103003 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103022 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103027 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103035 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103040 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103044 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103049 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103053 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103059 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103063 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103068 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103072 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103076 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:41:12.107501 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103081 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103085 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103094 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103098 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103103 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103107 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103113 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103118 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103124 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103129 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103134 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103139 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103144 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103148 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103160 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103166 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103171 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103175 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103180 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:41:12.108171 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103185 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103190 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103194 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103199 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103203 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103207 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103212 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103216 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103225 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103230 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103234 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103239 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103243 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103248 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103252 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103257 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103261 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103266 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103270 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103274 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:41:12.108624 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103282 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103293 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103297 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103302 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103307 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103311 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103315 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103320 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103325 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103329 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103333 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103339 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103349 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103353 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103358 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103362 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103366 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103371 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103375 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103379 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:41:12.109252 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103383 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103388 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103393 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.103397 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103572 2575 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103638 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103651 2575 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103659 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103666 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103672 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103685 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103693 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103699 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103706 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103712 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103718 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103724 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103729 2575 flags.go:64] FLAG: --cgroup-root="" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103734 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103741 2575 flags.go:64] FLAG: --client-ca-file="" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103744 2575 flags.go:64] FLAG: --cloud-provider="external" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103748 2575 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103758 2575 flags.go:64] FLAG: --cluster-domain="" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103761 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 17:41:12.109740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103784 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103952 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103963 2575 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103985 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103991 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.103997 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104003 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104021 2575 flags.go:64] FLAG: --contention-profiling="false" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104026 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104031 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104036 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104041 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104048 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104054 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104058 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104063 2575 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104067 2575 flags.go:64] FLAG: --enable-server="true" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104072 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104084 2575 flags.go:64] FLAG: --event-burst="100" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104089 2575 flags.go:64] FLAG: --event-qps="50" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104094 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104098 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104105 2575 flags.go:64] FLAG: --eviction-hard="" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104111 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 17:41:12.110334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104116 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104120 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104125 2575 flags.go:64] FLAG: --eviction-soft="" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104130 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104135 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104140 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104145 2575 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104149 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104154 2575 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104160 2575 flags.go:64] FLAG: --feature-gates="" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104167 2575 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104173 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104178 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104184 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104189 2575 flags.go:64] FLAG: --healthz-port="10248" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104194 2575 flags.go:64] FLAG: --help="false" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104199 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104205 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104210 2575 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104215 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104221 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104228 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104233 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 17:41:12.110915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104238 2575 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104243 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104247 2575 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104252 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104257 2575 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104262 2575 flags.go:64] FLAG: --kube-reserved="" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104267 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104271 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104276 2575 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104281 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104286 2575 flags.go:64] FLAG: --lock-file="" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104291 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104296 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104301 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104310 2575 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104314 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104319 2575 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104324 2575 flags.go:64] FLAG: --logging-format="text" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104331 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104337 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104342 2575 flags.go:64] FLAG: --manifest-url="" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104347 2575 flags.go:64] FLAG: --manifest-url-header="" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104355 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104360 2575 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104366 2575 flags.go:64] FLAG: --max-pods="110" Sep 17 17:41:12.111511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104372 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104376 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104381 2575 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104385 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104390 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104395 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104400 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104414 2575 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104419 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104425 2575 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104431 2575 flags.go:64] FLAG: --pod-cidr="" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104435 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104444 2575 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104449 2575 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104454 2575 flags.go:64] FLAG: --pods-per-core="0" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104458 2575 flags.go:64] FLAG: --port="10250" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104463 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104468 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dd3cb7e5e67fc310" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104473 2575 flags.go:64] FLAG: --qos-reserved="" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104478 2575 flags.go:64] FLAG: --read-only-port="10255" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104483 2575 flags.go:64] FLAG: --register-node="true" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104488 2575 flags.go:64] FLAG: --register-with-taints="" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104494 2575 flags.go:64] FLAG: --registry-burst="10" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104499 2575 flags.go:64] FLAG: --registry-qps="5" Sep 17 17:41:12.112173 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104505 2575 flags.go:64] FLAG: --reserved-cpus="" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104510 2575 flags.go:64] FLAG: --reserved-memory="" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104521 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104527 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104532 2575 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104537 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104541 2575 flags.go:64] FLAG: --runonce="false" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104546 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104550 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104556 2575 flags.go:64] FLAG: --seccomp-default="false" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104561 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104565 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104570 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104575 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104581 2575 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104586 2575 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104590 2575 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104595 2575 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104600 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104606 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104610 2575 flags.go:64] FLAG: --system-cgroups="" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104615 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104626 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104631 2575 flags.go:64] FLAG: --tls-cert-file="" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104635 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 17:41:12.112846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104643 2575 flags.go:64] FLAG: --tls-min-version="" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104649 2575 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104653 2575 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104658 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104663 2575 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104668 2575 flags.go:64] FLAG: --v="2" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104675 2575 flags.go:64] FLAG: --version="false" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104681 2575 flags.go:64] FLAG: --vmodule="" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104691 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.104699 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104890 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104901 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104906 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104911 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104915 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104920 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104924 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104929 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104933 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104937 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104941 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104945 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:41:12.113496 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104949 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104953 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104957 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104962 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104966 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104971 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104975 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104980 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104984 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104988 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104992 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.104996 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105000 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105021 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105026 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105030 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105037 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105042 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105046 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105054 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:41:12.114068 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105059 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105063 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105068 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105072 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105076 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105081 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105085 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105089 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105093 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105099 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105105 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105110 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105115 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105119 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105123 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105127 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105132 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105136 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105140 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:41:12.114572 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105144 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105148 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105152 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105157 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105161 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105165 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105170 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105174 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105178 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105184 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105188 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105193 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105198 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105204 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105210 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105215 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105220 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105225 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105229 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:41:12.115058 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105234 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105238 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105242 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105247 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105252 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105256 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105260 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105264 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105269 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105273 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105277 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105282 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105286 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105290 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105294 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105299 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105303 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105307 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105311 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105315 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:41:12.115530 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105320 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105324 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105330 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105337 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105343 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105349 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105353 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105358 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.105362 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.106042 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.113865 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.113892 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.113914 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.113920 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 17:41:12.116090 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.113986 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.113992 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.113996 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.113999 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114003 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114022 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114026 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114030 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114034 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114037 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114039 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114043 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114046 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114048 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114051 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114054 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114056 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114061 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114065 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:41:12.116449 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114069 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114073 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114076 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114079 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114081 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114085 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114088 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114091 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114093 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114097 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114103 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114106 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114109 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114111 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114115 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114118 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114120 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114123 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114126 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114129 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:41:12.116916 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114132 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114135 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114138 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114140 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114143 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114146 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114148 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114151 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114153 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114156 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114158 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114161 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114164 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114166 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114169 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114171 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114174 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114176 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114179 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114182 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:41:12.117432 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114185 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114188 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114191 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114195 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114198 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114200 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114203 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114206 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114209 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114211 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114214 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114217 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114219 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114222 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114224 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114227 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114229 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114232 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114236 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114239 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:41:12.117921 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114242 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114245 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114248 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114251 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114254 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114257 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114259 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114262 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114265 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114267 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114270 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114272 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114275 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114279 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114284 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114287 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114291 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114294 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114296 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:41:12.118581 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114299 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.114305 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114447 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114451 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114455 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114458 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114460 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114463 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114467 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114470 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114472 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114475 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114477 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114481 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114484 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:41:12.119102 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114486 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114489 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114492 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114494 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114497 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114499 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114502 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114504 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114507 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114509 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114512 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114524 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114528 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114532 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114536 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114541 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114544 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114548 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114550 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:41:12.119478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114553 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114556 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114559 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114561 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114564 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114566 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114569 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114572 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114574 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114578 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114581 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114584 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114588 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114591 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114594 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114596 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114599 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114601 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114604 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114607 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:41:12.119948 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114609 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114612 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114614 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114617 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114620 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114624 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114627 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114629 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114632 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114635 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114638 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114640 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114643 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114645 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114648 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114650 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114653 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114656 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114658 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114661 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:41:12.120554 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114663 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114665 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114668 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114670 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114673 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114676 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114678 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114681 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114683 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114686 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114689 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114692 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114695 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114698 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114700 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114703 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114705 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114708 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114713 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:41:12.121055 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114716 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114719 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114722 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114728 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114732 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114734 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114737 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:12.114740 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.114745 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.114909 2575 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.117131 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.117934 2575 server.go:1019] "Starting client certificate rotation" Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.118042 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:41:12.121529 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.118087 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:41:12.121958 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.120257 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:41:12.126878 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.122239 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:41:12.129683 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.129662 2575 log.go:25] "Validated CRI v1 runtime API" Sep 17 17:41:12.132214 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.132189 2575 log.go:25] "Validated CRI v1 image API" Sep 17 17:41:12.133722 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.133703 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 17:41:12.136251 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.136209 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 810f1e6c-7fdc-42bb-8efc-37800e84af71:/dev/nvme0n1p4 8fae7b5c-4d4c-49d2-9cee-c416252e18b3:/dev/nvme0n1p3] Sep 17 17:41:12.136362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.136248 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 17:41:12.143491 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.143345 2575 manager.go:216] Machine: {Timestamp:2026-09-17 17:41:12.142803492 +0000 UTC m=+1.986947511 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110474 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aa015c3bb185ddaa4a7049b3f7d0d SystemUUID:ec2aa015-c3bb-185d-daa4-a7049b3f7d0d BootID:b2aadc42-c94a-4cc0-8c73-a58c691aef00 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fe:b8:3d:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fe:b8:3d:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:0a:bc:c8:b1:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 17:41:12.143491 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.143460 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 17:41:12.143691 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.143566 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 17:41:12.145172 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.145129 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 17:41:12.145331 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.145178 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-71.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 17:41:12.146670 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.146653 2575 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 17:41:12.146713 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.146673 2575 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 17:41:12.146713 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.146682 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:41:12.146713 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.146697 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:41:12.146798 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.146789 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 17:41:12.149630 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.149611 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:41:12.149772 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.149763 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 17:41:12.149819 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.149809 2575 kubelet.go:486] "Attempting to sync node with API server" Sep 17 17:41:12.149851 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.149835 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 17:41:12.149878 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.149861 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 17:41:12.149878 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.149874 2575 kubelet.go:398] "Adding apiserver pod source" Sep 17 17:41:12.149932 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.149885 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 17:41:12.150466 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.150442 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:41:12.150466 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.150462 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:41:12.152536 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.152518 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 17:41:12.154804 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.154784 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 17:41:12.154914 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.154823 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 17:41:12.155940 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.155925 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 17:41:12.156000 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.155944 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 17:41:12.156000 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.155953 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 17:41:12.156000 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.155961 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 17:41:12.156000 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.155974 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 17:41:12.156000 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.155982 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156001 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156024 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156035 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156043 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156056 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156063 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156101 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 17:41:12.156185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156107 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 17:41:12.156832 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.156810 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:41:12.160252 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.160237 2575 server.go:1268] "Started kubelet" Sep 17 17:41:12.160368 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.160299 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 17:41:12.160572 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.160317 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 17:41:12.160673 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.160614 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 17:41:12.161427 ip-10-0-142-71 systemd[1]: Started Kubernetes Kubelet. Sep 17 17:41:12.162099 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.161655 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 17:41:12.162099 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.162036 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 17:41:12.162099 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.162067 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-71.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 17:41:12.162337 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.162107 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 17:41:12.163777 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.163755 2575 server.go:310] "Adding debug handlers to kubelet server" Sep 17 17:41:12.193026 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.192967 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 17:41:12.196999 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.196960 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 17:41:12.196999 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.196979 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 17:41:12.197260 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.196388 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-71.ec2.internal.18d62c89c564b8ec default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-71.ec2.internal,UID:ip-10-0-142-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-71.ec2.internal,},FirstTimestamp:2026-09-17 17:41:12.160205036 +0000 UTC m=+2.004349054,LastTimestamp:2026-09-17 17:41:12.160205036 +0000 UTC m=+2.004349054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-71.ec2.internal,}" Sep 17 17:41:12.197260 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.197250 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.197633 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.197613 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 17:41:12.197708 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.197672 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 17:41:12.197708 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.197690 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 17:41:12.197850 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.197831 2575 reconstruct.go:97] "Volume reconstruction finished" Sep 17 17:41:12.197850 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.197845 2575 reconciler.go:29] "Reconciler: start to sync state" Sep 17 17:41:12.198229 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.198212 2575 factory.go:55] Registering systemd factory Sep 17 17:41:12.198344 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.198329 2575 factory.go:223] Registration of the systemd container factory successfully Sep 17 17:41:12.198610 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.198595 2575 factory.go:153] Registering CRI-O factory Sep 17 17:41:12.198610 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.198612 2575 factory.go:223] Registration of the crio container factory successfully Sep 17 17:41:12.198735 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.198675 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 17:41:12.198735 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.198696 2575 factory.go:103] Registering Raw factory Sep 17 17:41:12.198735 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.198711 2575 manager.go:1196] Started watching for new ooms in manager Sep 17 17:41:12.199413 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.199396 2575 manager.go:349] Starting recovery of all containers Sep 17 17:41:12.199579 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.199553 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9lprp" Sep 17 17:41:12.208773 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.208737 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9lprp" Sep 17 17:41:12.213340 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.213048 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 17:41:12.213520 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.213447 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 17:41:12.214664 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.214644 2575 manager.go:354] Recovery completed Sep 17 17:41:12.219178 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.219160 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:41:12.223683 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.223658 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:41:12.223762 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.223698 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:41:12.223762 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.223710 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:41:12.224397 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.224379 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:41:12.224497 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.224380 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 17:41:12.224497 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.224445 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 17:41:12.224497 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.224464 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:41:12.225210 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.225195 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:41:12.225274 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.225226 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:41:12.225274 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.225235 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:41:12.225828 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.225816 2575 policy_none.go:49] "None policy: Start" Sep 17 17:41:12.225864 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.225832 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 17:41:12.225864 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.225843 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 17:41:12.227082 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.227065 2575 policy_none.go:47] "Start" Sep 17 17:41:12.270902 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.270858 2575 manager.go:337] "Starting Device Plugin manager" Sep 17 17:41:12.270902 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.270937 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 17:41:12.270902 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.270965 2575 server.go:87] "Starting device plugin registration server" Sep 17 17:41:12.275232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.271335 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 17:41:12.275232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.271358 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 17:41:12.275232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.271483 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 17:41:12.275232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.271594 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 17:41:12.275232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.271604 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 17:41:12.275232 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.272394 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 17:41:12.275232 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.272456 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.333176 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.333129 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 17:41:12.334470 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.334454 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 17:41:12.334604 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.334512 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 17:41:12.334604 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.334553 2575 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 17:41:12.334701 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.334601 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 17:41:12.337415 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.337392 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:41:12.371804 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.371724 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:41:12.372794 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.372776 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:41:12.372918 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.372808 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:41:12.372918 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.372824 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:41:12.372918 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.372849 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.381577 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.381553 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.381688 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.381586 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-71.ec2.internal\": node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.399272 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.399233 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.435592 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.435538 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal"] Sep 17 17:41:12.435743 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.435652 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:41:12.437384 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.437363 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:41:12.437525 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.437402 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:41:12.437525 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.437416 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:41:12.438953 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.438938 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:41:12.439083 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.439142 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439127 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:41:12.439825 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439807 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:41:12.439825 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439815 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:41:12.439996 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439840 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:41:12.439996 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439840 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:41:12.439996 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439865 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:41:12.439996 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.439850 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:41:12.441463 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.441447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.441559 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.441479 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:41:12.442313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.442295 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:41:12.442427 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.442325 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:41:12.442427 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.442340 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:41:12.471019 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.470975 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-71.ec2.internal\" not found" node="ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.475705 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.475683 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-71.ec2.internal\" not found" node="ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.500148 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.500117 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.500297 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.500208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c5e35a777e08f96da9ac1513824707b6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-71.ec2.internal\" (UID: \"c5e35a777e08f96da9ac1513824707b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.500297 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.500231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3060332f246039c5221c2c4d609002b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal\" (UID: \"3060332f246039c5221c2c4d609002b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.500297 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.500249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3060332f246039c5221c2c4d609002b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal\" (UID: \"3060332f246039c5221c2c4d609002b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.601230 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.601184 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.601416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.601237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c5e35a777e08f96da9ac1513824707b6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-71.ec2.internal\" (UID: \"c5e35a777e08f96da9ac1513824707b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.601416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.601263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3060332f246039c5221c2c4d609002b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal\" (UID: \"3060332f246039c5221c2c4d609002b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.601416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.601280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3060332f246039c5221c2c4d609002b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal\" (UID: \"3060332f246039c5221c2c4d609002b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.601416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.601350 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c5e35a777e08f96da9ac1513824707b6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-71.ec2.internal\" (UID: \"c5e35a777e08f96da9ac1513824707b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.601416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.601409 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3060332f246039c5221c2c4d609002b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal\" (UID: \"3060332f246039c5221c2c4d609002b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.601571 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.601434 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3060332f246039c5221c2c4d609002b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal\" (UID: \"3060332f246039c5221c2c4d609002b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.702362 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.702269 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.775506 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.775466 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.780348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:12.780048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:12.802883 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.802834 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:12.903318 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:12.903269 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:13.003881 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.003769 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-71.ec2.internal\" not found" Sep 17 17:41:13.046450 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.046422 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:41:13.098054 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.098023 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" Sep 17 17:41:13.114834 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.114801 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:41:13.116566 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.116546 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:13.117890 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.117871 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 17:41:13.118048 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.118025 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:41:13.118109 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.118024 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:41:13.118109 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.118049 2575 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a3995170ec33944309497dbc5040364d-793b8c5c358b5692.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.142.71:52684->52.3.27.45:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:13.150253 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.150218 2575 apiserver.go:52] "Watching apiserver" Sep 17 17:41:13.163962 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.163929 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 17:41:13.164366 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.164343 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xbvhh","kube-system/konnectivity-agent-lvjhz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft","openshift-cluster-node-tuning-operator/tuned-z5gkm","openshift-dns/node-resolver-6s8cq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal","openshift-multus/multus-c4hnh","openshift-multus/network-metrics-daemon-5pcvf","openshift-image-registry/node-ca-pl5mt","openshift-multus/multus-additional-cni-plugins-j9bdn","openshift-network-diagnostics/network-check-target-8q5wm","openshift-network-operator/iptables-alerter-x6tbh","openshift-ovn-kubernetes/ovnkube-node-6flgw"] Sep 17 17:41:13.166142 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.166117 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.167507 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.167471 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.168100 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.168074 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 17:41:13.168218 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.168077 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 17:41:13.168218 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.168127 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 17:41:13.168218 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.168076 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 17:41:13.168218 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.168193 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jw6qb\"" Sep 17 17:41:13.169222 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.169200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.169695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.169671 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 17:41:13.170362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.170336 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cbmx2\"" Sep 17 17:41:13.170693 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.170626 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 17:41:13.171074 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.170996 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.171256 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.171238 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 17:41:13.172206 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.172181 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6jq5\"" Sep 17 17:41:13.172206 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.172201 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 17:41:13.172382 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.172216 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 17:41:13.172816 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.172798 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.173100 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.173084 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 17:41:13.173179 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.173090 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-drqnh\"" Sep 17 17:41:13.173228 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.173205 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:41:13.174307 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.174291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.174388 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.174356 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:13.174450 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.174436 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 17:41:13.174502 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.174490 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kb52x\"" Sep 17 17:41:13.174670 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.174655 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 17:41:13.175521 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.175508 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:13.175589 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.175574 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:13.176760 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.176743 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.178046 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.178030 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.178322 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.178299 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 17:41:13.178419 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.178382 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 17:41:13.178664 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.178647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cptkl\"" Sep 17 17:41:13.178738 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.178648 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 17:41:13.179313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.179299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:13.179417 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.179394 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:13.179787 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.179771 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 17:41:13.179787 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.179783 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 17:41:13.179898 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.179771 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-llgzl\"" Sep 17 17:41:13.181234 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.181218 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.183049 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.183025 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:41:13.183049 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.183045 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 17:41:13.183219 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.183058 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z6cb9\"" Sep 17 17:41:13.183219 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.183084 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 17:41:13.183219 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.183143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.185136 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.184938 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 17:41:13.185136 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.185109 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 17:41:13.185236 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.185165 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 17:41:13.185315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.185300 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ktglk\"" Sep 17 17:41:13.185532 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.185498 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 17:41:13.185635 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.185586 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 17:41:13.185730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.185710 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 17:41:13.198186 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.198150 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 17:41:13.199038 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.198997 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 17:41:13.204612 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-socket-dir-parent\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.204751 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-slash\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.204751 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-systemd\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.204751 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62040b3e-71ad-4ee6-a954-853b6df70e6d-hosts-file\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.204751 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-kube-api-access-xkskb\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.204751 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v6kx\" (UniqueName: \"kubernetes.io/projected/77b8deff-70f4-47b1-8d3b-618e91a26496-kube-api-access-4v6kx\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.204751 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-run\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-sys\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-kubelet\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-ovnkube-script-lib\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204963 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysctl-d\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.204988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d91a8e46-100d-4354-8cf9-701190356708-dbus\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-cni-binary-copy\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.205084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grhtm\" (UniqueName: \"kubernetes.io/projected/b69366f1-b9cc-445d-9925-e42f2b8cb129-kube-api-access-grhtm\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-var-lib-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-cni-bin\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205146 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-socket-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysctl-conf\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp82h\" (UniqueName: \"kubernetes.io/projected/3a0fc094-7d0a-4f58-b092-0931601d37f0-kube-api-access-qp82h\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e63fc9f-bfb4-44b2-9593-79bb966ab745-agent-certs\") pod \"konnectivity-agent-lvjhz\" (UID: \"8e63fc9f-bfb4-44b2-9593-79bb966ab745\") " pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-kubelet\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-registration-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-tmp\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.205358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77b8deff-70f4-47b1-8d3b-618e91a26496-iptables-alerter-script\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-etc-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-run-ovn-kubernetes\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-hostroot\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-cnibin\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-multus-certs\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77b8deff-70f4-47b1-8d3b-618e91a26496-host-slash\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205599 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4hb7\" (UniqueName: \"kubernetes.io/projected/5c5f7454-c62e-479a-97d7-68468080eb78-kube-api-access-r4hb7\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-modprobe-d\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-lib-modules\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205657 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-host\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.205689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-conf-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct4xg\" (UniqueName: \"kubernetes.io/projected/f50d1f52-3b82-440e-96d0-d8b26abd81c9-kube-api-access-ct4xg\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-serviceca\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-daemon-config\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-system-cni-dir\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysconfig\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc4kb\" (UniqueName: \"kubernetes.io/projected/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-kube-api-access-hc4kb\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjv6s\" (UniqueName: \"kubernetes.io/projected/62040b3e-71ad-4ee6-a954-853b6df70e6d-kube-api-access-mjv6s\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205912 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-cni-bin\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-etc-kubernetes\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-log-socket\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.205989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-cni-netd\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kbbq\" (UniqueName: \"kubernetes.io/projected/4a809c26-8c16-4cfd-b368-b6fcec691758-kube-api-access-7kbbq\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-systemd\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-system-cni-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206204 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-cni-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-systemd-units\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-node-log\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d91a8e46-100d-4354-8cf9-701190356708-kubelet-config\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-env-overrides\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-device-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-tuned\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a809c26-8c16-4cfd-b368-b6fcec691758-ovn-node-metrics-cert\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a0fc094-7d0a-4f58-b092-0931601d37f0-cni-binary-copy\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-k8s-cni-cncf-io\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-run-netns\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-kubernetes\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-host\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e63fc9f-bfb4-44b2-9593-79bb966ab745-konnectivity-ca\") pod \"konnectivity-agent-lvjhz\" (UID: \"8e63fc9f-bfb4-44b2-9593-79bb966ab745\") " pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.206892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-cnibin\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-ovn\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-ovnkube-config\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-var-lib-kubelet\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-netns\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-cni-multus\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-sys-fs\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.207602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.206779 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62040b3e-71ad-4ee6-a954-853b6df70e6d-tmp-dir\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.211025 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.210984 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:41:13.213678 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.213630 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:36:12 +0000 UTC" deadline="2028-06-18 13:41:31.012207786 +0000 UTC" Sep 17 17:41:13.213678 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.213671 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15356h0m17.798538864s" Sep 17 17:41:13.233167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.233135 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvwzw" Sep 17 17:41:13.241655 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.241627 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvwzw" Sep 17 17:41:13.307444 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-slash\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-systemd\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62040b3e-71ad-4ee6-a954-853b6df70e6d-hosts-file\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-slash\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-kube-api-access-xkskb\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-systemd\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307543 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62040b3e-71ad-4ee6-a954-853b6df70e6d-hosts-file\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307557 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v6kx\" (UniqueName: \"kubernetes.io/projected/77b8deff-70f4-47b1-8d3b-618e91a26496-kube-api-access-4v6kx\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307616 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-run\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-sys\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.307671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-kubelet\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-ovnkube-script-lib\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-run\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysctl-d\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d91a8e46-100d-4354-8cf9-701190356708-dbus\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-kubelet\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307935 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysctl-d\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.307981 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-sys\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-cni-binary-copy\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grhtm\" (UniqueName: \"kubernetes.io/projected/b69366f1-b9cc-445d-9925-e42f2b8cb129-kube-api-access-grhtm\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-var-lib-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-cni-bin\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308131 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-socket-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysctl-conf\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308171 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp82h\" (UniqueName: \"kubernetes.io/projected/3a0fc094-7d0a-4f58-b092-0931601d37f0-kube-api-access-qp82h\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.308230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e63fc9f-bfb4-44b2-9593-79bb966ab745-agent-certs\") pod \"konnectivity-agent-lvjhz\" (UID: \"8e63fc9f-bfb4-44b2-9593-79bb966ab745\") " pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-kubelet\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-registration-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-tmp\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308318 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77b8deff-70f4-47b1-8d3b-618e91a26496-iptables-alerter-script\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-etc-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308348 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-run-ovn-kubernetes\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-hostroot\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-cnibin\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308510 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysctl-conf\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-multus-certs\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77b8deff-70f4-47b1-8d3b-618e91a26496-host-slash\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308577 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-ovnkube-script-lib\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308616 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4hb7\" (UniqueName: \"kubernetes.io/projected/5c5f7454-c62e-479a-97d7-68468080eb78-kube-api-access-r4hb7\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:13.308956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308620 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-run-ovn-kubernetes\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-modprobe-d\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308647 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-cnibin\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-lib-modules\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-host\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-conf-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct4xg\" (UniqueName: \"kubernetes.io/projected/f50d1f52-3b82-440e-96d0-d8b26abd81c9-kube-api-access-ct4xg\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-serviceca\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-cni-bin\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-etc-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308796 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-daemon-config\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-system-cni-dir\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysconfig\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308957 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc4kb\" (UniqueName: \"kubernetes.io/projected/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-kube-api-access-hc4kb\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjv6s\" (UniqueName: \"kubernetes.io/projected/62040b3e-71ad-4ee6-a954-853b6df70e6d-kube-api-access-mjv6s\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-cni-bin\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.309872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-etc-kubernetes\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-log-socket\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309087 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-conf-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-cni-netd\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.308852 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77b8deff-70f4-47b1-8d3b-618e91a26496-host-slash\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309203 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-socket-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-var-lib-openvswitch\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309476 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-sysconfig\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309499 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-host\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309520 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kbbq\" (UniqueName: \"kubernetes.io/projected/4a809c26-8c16-4cfd-b368-b6fcec691758-kube-api-access-7kbbq\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-multus-certs\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-systemd\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309620 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-systemd\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-modprobe-d\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.310736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309649 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-system-cni-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-cni-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-systemd-units\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.309701 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-node-log\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309725 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-lib-modules\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d91a8e46-100d-4354-8cf9-701190356708-kubelet-config\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309780 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-registration-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.309795 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret podName:d91a8e46-100d-4354-8cf9-701190356708 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:13.809755674 +0000 UTC m=+3.653899695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret") pod "global-pull-secret-syncer-xbvhh" (UID: "d91a8e46-100d-4354-8cf9-701190356708") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309802 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d91a8e46-100d-4354-8cf9-701190356708-kubelet-config\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-env-overrides\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-device-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-tuned\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a809c26-8c16-4cfd-b368-b6fcec691758-ovn-node-metrics-cert\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.309979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a0fc094-7d0a-4f58-b092-0931601d37f0-cni-binary-copy\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.311623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-k8s-cni-cncf-io\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-run-netns\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-kubernetes\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-host\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e63fc9f-bfb4-44b2-9593-79bb966ab745-konnectivity-ca\") pod \"konnectivity-agent-lvjhz\" (UID: \"8e63fc9f-bfb4-44b2-9593-79bb966ab745\") " pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310160 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-serviceca\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310336 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77b8deff-70f4-47b1-8d3b-618e91a26496-iptables-alerter-script\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310361 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-daemon-config\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310392 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-system-cni-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-etc-kubernetes\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310409 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-systemd-units\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-node-log\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-log-socket\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310479 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-cni-bin\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-cni-dir\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d91a8e46-100d-4354-8cf9-701190356708-dbus\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-hostroot\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310647 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-device-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.312433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e63fc9f-bfb4-44b2-9593-79bb966ab745-konnectivity-ca\") pod \"konnectivity-agent-lvjhz\" (UID: \"8e63fc9f-bfb4-44b2-9593-79bb966ab745\") " pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310897 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310927 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-kubelet\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310943 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310963 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-system-cni-dir\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.310968 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-env-overrides\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-cnibin\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-ovn\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-ovnkube-config\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-var-lib-kubelet\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311194 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-cni-netd\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-netns\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a0fc094-7d0a-4f58-b092-0931601d37f0-cni-binary-copy\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-cni-multus\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-sys-fs\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.313353 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62040b3e-71ad-4ee6-a954-853b6df70e6d-tmp-dir\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-socket-dir-parent\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b69366f1-b9cc-445d-9925-e42f2b8cb129-cni-binary-copy\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311517 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-multus-socket-dir-parent\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-kubernetes\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-host\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311588 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311588 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b69366f1-b9cc-445d-9925-e42f2b8cb129-cnibin\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311619 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-run-ovn\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311648 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-netns\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-var-lib-cni-multus\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.311688 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.311742 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs podName:5c5f7454-c62e-479a-97d7-68468080eb78 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:13.811723372 +0000 UTC m=+3.655867399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs") pod "network-metrics-daemon-5pcvf" (UID: "5c5f7454-c62e-479a-97d7-68468080eb78") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a0fc094-7d0a-4f58-b092-0931601d37f0-host-run-k8s-cni-cncf-io\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311842 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f50d1f52-3b82-440e-96d0-d8b26abd81c9-sys-fs\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311843 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62040b3e-71ad-4ee6-a954-853b6df70e6d-tmp-dir\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a809c26-8c16-4cfd-b368-b6fcec691758-host-run-netns\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.314144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.311905 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-var-lib-kubelet\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.314643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.312313 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a809c26-8c16-4cfd-b368-b6fcec691758-ovnkube-config\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.314643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.313048 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-etc-tuned\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.314643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.313068 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-tmp\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.314643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.313576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e63fc9f-bfb4-44b2-9593-79bb966ab745-agent-certs\") pod \"konnectivity-agent-lvjhz\" (UID: \"8e63fc9f-bfb4-44b2-9593-79bb966ab745\") " pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.314643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.314291 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a809c26-8c16-4cfd-b368-b6fcec691758-ovn-node-metrics-cert\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.319023 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.318977 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v6kx\" (UniqueName: \"kubernetes.io/projected/77b8deff-70f4-47b1-8d3b-618e91a26496-kube-api-access-4v6kx\") pod \"iptables-alerter-x6tbh\" (UID: \"77b8deff-70f4-47b1-8d3b-618e91a26496\") " pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.319200 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.319170 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:41:13.319200 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.319193 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:41:13.319317 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.319208 2575 projected.go:196] Error preparing data for projected volume kube-api-access-9thgd for pod openshift-network-diagnostics/network-check-target-8q5wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:13.319317 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.319274 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd podName:dbe0a188-b3ed-4c4a-9af4-98bd01e15f85 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:13.819256472 +0000 UTC m=+3.663400478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9thgd" (UniqueName: "kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd") pod "network-check-target-8q5wm" (UID: "dbe0a188-b3ed-4c4a-9af4-98bd01e15f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:13.322939 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.322900 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc4kb\" (UniqueName: \"kubernetes.io/projected/9c76f3be-34cb-4d05-bf7e-7fb1417a3380-kube-api-access-hc4kb\") pod \"tuned-z5gkm\" (UID: \"9c76f3be-34cb-4d05-bf7e-7fb1417a3380\") " pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.323137 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.323053 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grhtm\" (UniqueName: \"kubernetes.io/projected/b69366f1-b9cc-445d-9925-e42f2b8cb129-kube-api-access-grhtm\") pod \"multus-additional-cni-plugins-j9bdn\" (UID: \"b69366f1-b9cc-445d-9925-e42f2b8cb129\") " pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.323280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.323256 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4hb7\" (UniqueName: \"kubernetes.io/projected/5c5f7454-c62e-479a-97d7-68468080eb78-kube-api-access-r4hb7\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:13.324151 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.324119 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct4xg\" (UniqueName: \"kubernetes.io/projected/f50d1f52-3b82-440e-96d0-d8b26abd81c9-kube-api-access-ct4xg\") pod \"aws-ebs-csi-driver-node-s7jft\" (UID: \"f50d1f52-3b82-440e-96d0-d8b26abd81c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.324765 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.324733 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkskb\" (UniqueName: \"kubernetes.io/projected/f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2-kube-api-access-xkskb\") pod \"node-ca-pl5mt\" (UID: \"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2\") " pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.325405 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.325370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kbbq\" (UniqueName: \"kubernetes.io/projected/4a809c26-8c16-4cfd-b368-b6fcec691758-kube-api-access-7kbbq\") pod \"ovnkube-node-6flgw\" (UID: \"4a809c26-8c16-4cfd-b368-b6fcec691758\") " pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.327090 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.327062 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjv6s\" (UniqueName: \"kubernetes.io/projected/62040b3e-71ad-4ee6-a954-853b6df70e6d-kube-api-access-mjv6s\") pod \"node-resolver-6s8cq\" (UID: \"62040b3e-71ad-4ee6-a954-853b6df70e6d\") " pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.327178 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.327086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp82h\" (UniqueName: \"kubernetes.io/projected/3a0fc094-7d0a-4f58-b092-0931601d37f0-kube-api-access-qp82h\") pod \"multus-c4hnh\" (UID: \"3a0fc094-7d0a-4f58-b092-0931601d37f0\") " pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.338835 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.338808 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x6tbh" Sep 17 17:41:13.344426 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.344395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:13.442918 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.442871 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3060332f246039c5221c2c4d609002b7.slice/crio-1364e4526a27bb6998def9c0643d4c524876dabbfd898d3595d965d0ee255f13 WatchSource:0}: Error finding container 1364e4526a27bb6998def9c0643d4c524876dabbfd898d3595d965d0ee255f13: Status 404 returned error can't find the container with id 1364e4526a27bb6998def9c0643d4c524876dabbfd898d3595d965d0ee255f13 Sep 17 17:41:13.443481 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.443464 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e35a777e08f96da9ac1513824707b6.slice/crio-2c6a8205dbf1c6f42c284483b3eb324bd6ca5f38ba6d4206d77e96b1b22b5d72 WatchSource:0}: Error finding container 2c6a8205dbf1c6f42c284483b3eb324bd6ca5f38ba6d4206d77e96b1b22b5d72: Status 404 returned error can't find the container with id 2c6a8205dbf1c6f42c284483b3eb324bd6ca5f38ba6d4206d77e96b1b22b5d72 Sep 17 17:41:13.448549 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.448529 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:41:13.490503 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.490461 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c4hnh" Sep 17 17:41:13.498934 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.498898 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0fc094_7d0a_4f58_b092_0931601d37f0.slice/crio-97a93deaf0704bff3c977be568a6aeb830b34b09bad71fad13a9954a09500db4 WatchSource:0}: Error finding container 97a93deaf0704bff3c977be568a6aeb830b34b09bad71fad13a9954a09500db4: Status 404 returned error can't find the container with id 97a93deaf0704bff3c977be568a6aeb830b34b09bad71fad13a9954a09500db4 Sep 17 17:41:13.520114 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.520003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:13.527741 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.527714 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e63fc9f_bfb4_44b2_9593_79bb966ab745.slice/crio-74e02ebd4bc8b318004aa14483895ab70c47a73c1e63d372b8ce28a7fec657b9 WatchSource:0}: Error finding container 74e02ebd4bc8b318004aa14483895ab70c47a73c1e63d372b8ce28a7fec657b9: Status 404 returned error can't find the container with id 74e02ebd4bc8b318004aa14483895ab70c47a73c1e63d372b8ce28a7fec657b9 Sep 17 17:41:13.541520 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.541476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" Sep 17 17:41:13.549403 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.549373 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:41:13.549594 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.549439 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf50d1f52_3b82_440e_96d0_d8b26abd81c9.slice/crio-8997a8a5adfc8843f22eb70069b28fb147a8f1037414fd5d9b7fe9fb21f06f59 WatchSource:0}: Error finding container 8997a8a5adfc8843f22eb70069b28fb147a8f1037414fd5d9b7fe9fb21f06f59: Status 404 returned error can't find the container with id 8997a8a5adfc8843f22eb70069b28fb147a8f1037414fd5d9b7fe9fb21f06f59 Sep 17 17:41:13.557229 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.557198 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" Sep 17 17:41:13.565267 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.565241 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c76f3be_34cb_4d05_bf7e_7fb1417a3380.slice/crio-4f7cd66b242e2b2da7df6ef8a999629f47ff7b102a65ada25e58f2badb323495 WatchSource:0}: Error finding container 4f7cd66b242e2b2da7df6ef8a999629f47ff7b102a65ada25e58f2badb323495: Status 404 returned error can't find the container with id 4f7cd66b242e2b2da7df6ef8a999629f47ff7b102a65ada25e58f2badb323495 Sep 17 17:41:13.573721 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.573694 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6s8cq" Sep 17 17:41:13.582482 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.582453 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62040b3e_71ad_4ee6_a954_853b6df70e6d.slice/crio-22ea21efc379f803e3b06ad57eb6673760e657d5c4923c92001d4aa7ff2839e2 WatchSource:0}: Error finding container 22ea21efc379f803e3b06ad57eb6673760e657d5c4923c92001d4aa7ff2839e2: Status 404 returned error can't find the container with id 22ea21efc379f803e3b06ad57eb6673760e657d5c4923c92001d4aa7ff2839e2 Sep 17 17:41:13.586923 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.586890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pl5mt" Sep 17 17:41:13.594767 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.594739 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2bc57f3_e523_4ac0_9a35_d6d0e30fdef2.slice/crio-f4f80c9f8ec73f1fdc873c6f7b6296a59b99da67681e6a5cdbce07109d071eb9 WatchSource:0}: Error finding container f4f80c9f8ec73f1fdc873c6f7b6296a59b99da67681e6a5cdbce07109d071eb9: Status 404 returned error can't find the container with id f4f80c9f8ec73f1fdc873c6f7b6296a59b99da67681e6a5cdbce07109d071eb9 Sep 17 17:41:13.602878 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.602850 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:41:13.605377 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.605357 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" Sep 17 17:41:13.614031 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.613972 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69366f1_b9cc_445d_9925_e42f2b8cb129.slice/crio-972e67c652b5c8c280238237b1ca1ecaeffa96310e1514e36e32adf4c6bff575 WatchSource:0}: Error finding container 972e67c652b5c8c280238237b1ca1ecaeffa96310e1514e36e32adf4c6bff575: Status 404 returned error can't find the container with id 972e67c652b5c8c280238237b1ca1ecaeffa96310e1514e36e32adf4c6bff575 Sep 17 17:41:13.672793 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.672758 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b8deff_70f4_47b1_8d3b_618e91a26496.slice/crio-f40998e59cfe0f3c652af7ff3649331fd3e2d513f6083e6d3d54ab32f5b33bd8 WatchSource:0}: Error finding container f40998e59cfe0f3c652af7ff3649331fd3e2d513f6083e6d3d54ab32f5b33bd8: Status 404 returned error can't find the container with id f40998e59cfe0f3c652af7ff3649331fd3e2d513f6083e6d3d54ab32f5b33bd8 Sep 17 17:41:13.756980 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:41:13.756941 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a809c26_8c16_4cfd_b368_b6fcec691758.slice/crio-ca0f598674dc49b1d6b40aaf93d37d3d96ab2f14bae4f95a424a4488b763dcdb WatchSource:0}: Error finding container ca0f598674dc49b1d6b40aaf93d37d3d96ab2f14bae4f95a424a4488b763dcdb: Status 404 returned error can't find the container with id ca0f598674dc49b1d6b40aaf93d37d3d96ab2f14bae4f95a424a4488b763dcdb Sep 17 17:41:13.814730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.814629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:13.814730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.814676 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:13.814928 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.814786 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:13.814928 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.814844 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret podName:d91a8e46-100d-4354-8cf9-701190356708 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:14.81482717 +0000 UTC m=+4.658971177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret") pod "global-pull-secret-syncer-xbvhh" (UID: "d91a8e46-100d-4354-8cf9-701190356708") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:13.814928 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.814787 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:13.814928 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.814915 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs podName:5c5f7454-c62e-479a-97d7-68468080eb78 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:14.814902154 +0000 UTC m=+4.659046164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs") pod "network-metrics-daemon-5pcvf" (UID: "5c5f7454-c62e-479a-97d7-68468080eb78") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:13.915939 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.915893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:13.916163 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.916113 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:41:13.916163 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.916146 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:41:13.916163 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.916160 2575 projected.go:196] Error preparing data for projected volume kube-api-access-9thgd for pod openshift-network-diagnostics/network-check-target-8q5wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:13.916324 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:13.916234 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd podName:dbe0a188-b3ed-4c4a-9af4-98bd01e15f85 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:14.916213704 +0000 UTC m=+4.760357723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9thgd" (UniqueName: "kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd") pod "network-check-target-8q5wm" (UID: "dbe0a188-b3ed-4c4a-9af4-98bd01e15f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:13.944902 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:13.944644 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:41:14.244406 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.244307 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:36:13 +0000 UTC" deadline="2028-02-19 04:16:04.052866715 +0000 UTC" Sep 17 17:41:14.244406 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.244346 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12466h34m49.80852564s" Sep 17 17:41:14.343301 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.340279 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:14.343301 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.340471 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:14.378937 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.378864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6s8cq" event={"ID":"62040b3e-71ad-4ee6-a954-853b6df70e6d","Type":"ContainerStarted","Data":"22ea21efc379f803e3b06ad57eb6673760e657d5c4923c92001d4aa7ff2839e2"} Sep 17 17:41:14.394414 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.394270 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" event={"ID":"f50d1f52-3b82-440e-96d0-d8b26abd81c9","Type":"ContainerStarted","Data":"8997a8a5adfc8843f22eb70069b28fb147a8f1037414fd5d9b7fe9fb21f06f59"} Sep 17 17:41:14.422195 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.421625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" event={"ID":"3060332f246039c5221c2c4d609002b7","Type":"ContainerStarted","Data":"1364e4526a27bb6998def9c0643d4c524876dabbfd898d3595d965d0ee255f13"} Sep 17 17:41:14.429484 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.429415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x6tbh" event={"ID":"77b8deff-70f4-47b1-8d3b-618e91a26496","Type":"ContainerStarted","Data":"f40998e59cfe0f3c652af7ff3649331fd3e2d513f6083e6d3d54ab32f5b33bd8"} Sep 17 17:41:14.468806 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.468740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" event={"ID":"9c76f3be-34cb-4d05-bf7e-7fb1417a3380","Type":"ContainerStarted","Data":"4f7cd66b242e2b2da7df6ef8a999629f47ff7b102a65ada25e58f2badb323495"} Sep 17 17:41:14.481350 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.481253 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lvjhz" event={"ID":"8e63fc9f-bfb4-44b2-9593-79bb966ab745","Type":"ContainerStarted","Data":"74e02ebd4bc8b318004aa14483895ab70c47a73c1e63d372b8ce28a7fec657b9"} Sep 17 17:41:14.493640 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.493506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c4hnh" event={"ID":"3a0fc094-7d0a-4f58-b092-0931601d37f0","Type":"ContainerStarted","Data":"97a93deaf0704bff3c977be568a6aeb830b34b09bad71fad13a9954a09500db4"} Sep 17 17:41:14.517722 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.517527 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" event={"ID":"c5e35a777e08f96da9ac1513824707b6","Type":"ContainerStarted","Data":"2c6a8205dbf1c6f42c284483b3eb324bd6ca5f38ba6d4206d77e96b1b22b5d72"} Sep 17 17:41:14.542222 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.542178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"ca0f598674dc49b1d6b40aaf93d37d3d96ab2f14bae4f95a424a4488b763dcdb"} Sep 17 17:41:14.553805 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.553758 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerStarted","Data":"972e67c652b5c8c280238237b1ca1ecaeffa96310e1514e36e32adf4c6bff575"} Sep 17 17:41:14.577220 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.577163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pl5mt" event={"ID":"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2","Type":"ContainerStarted","Data":"f4f80c9f8ec73f1fdc873c6f7b6296a59b99da67681e6a5cdbce07109d071eb9"} Sep 17 17:41:14.826649 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.825791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:14.826649 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.825857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:14.826649 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.825988 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:14.826649 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.826073 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret podName:d91a8e46-100d-4354-8cf9-701190356708 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:16.826052128 +0000 UTC m=+6.670196199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret") pod "global-pull-secret-syncer-xbvhh" (UID: "d91a8e46-100d-4354-8cf9-701190356708") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:14.826649 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.826490 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:14.826649 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.826556 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs podName:5c5f7454-c62e-479a-97d7-68468080eb78 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:16.82654056 +0000 UTC m=+6.670684571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs") pod "network-metrics-daemon-5pcvf" (UID: "5c5f7454-c62e-479a-97d7-68468080eb78") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:14.926725 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:14.926533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:14.926936 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.926788 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:41:14.926936 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.926812 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:41:14.926936 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.926827 2575 projected.go:196] Error preparing data for projected volume kube-api-access-9thgd for pod openshift-network-diagnostics/network-check-target-8q5wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:14.926936 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:14.926895 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd podName:dbe0a188-b3ed-4c4a-9af4-98bd01e15f85 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:16.926875359 +0000 UTC m=+6.771019370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9thgd" (UniqueName: "kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd") pod "network-check-target-8q5wm" (UID: "dbe0a188-b3ed-4c4a-9af4-98bd01e15f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:15.245277 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:15.245109 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:36:13 +0000 UTC" deadline="2028-03-25 11:05:46.739942887 +0000 UTC" Sep 17 17:41:15.245277 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:15.245174 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13313h24m31.494772651s" Sep 17 17:41:15.335525 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:15.334959 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:15.335525 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:15.335147 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:15.335786 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:15.335578 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:15.335786 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:15.335675 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:16.203547 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:16.203493 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:41:16.337276 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:16.337237 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:16.337752 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.337391 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:16.843283 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:16.843224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:16.843486 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:16.843303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:16.843486 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.843471 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:16.843594 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.843540 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret podName:d91a8e46-100d-4354-8cf9-701190356708 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:20.843519945 +0000 UTC m=+10.687663955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret") pod "global-pull-secret-syncer-xbvhh" (UID: "d91a8e46-100d-4354-8cf9-701190356708") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:16.843654 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.843616 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:16.843705 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.843666 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs podName:5c5f7454-c62e-479a-97d7-68468080eb78 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:20.84365435 +0000 UTC m=+10.687798369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs") pod "network-metrics-daemon-5pcvf" (UID: "5c5f7454-c62e-479a-97d7-68468080eb78") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:16.944422 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:16.944377 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:16.944607 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.944579 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:41:16.944607 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.944602 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:41:16.944743 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.944619 2575 projected.go:196] Error preparing data for projected volume kube-api-access-9thgd for pod openshift-network-diagnostics/network-check-target-8q5wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:16.944743 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:16.944685 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd podName:dbe0a188-b3ed-4c4a-9af4-98bd01e15f85 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:20.944663933 +0000 UTC m=+10.788807944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9thgd" (UniqueName: "kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd") pod "network-check-target-8q5wm" (UID: "dbe0a188-b3ed-4c4a-9af4-98bd01e15f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:17.335473 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:17.335388 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:17.335645 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:17.335546 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:17.335645 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:17.335588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:17.335753 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:17.335676 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:18.334885 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:18.334849 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:18.335411 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:18.334991 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:19.335697 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:19.335651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:19.336217 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:19.335818 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:19.336332 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:19.336303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:19.336463 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:19.336416 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:20.337254 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:20.337163 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:20.337756 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.337338 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:20.880936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:20.880884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:20.881160 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:20.880950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:20.881160 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.881085 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:20.881160 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.881114 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:20.881316 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.881169 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs podName:5c5f7454-c62e-479a-97d7-68468080eb78 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:28.881147265 +0000 UTC m=+18.725291295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs") pod "network-metrics-daemon-5pcvf" (UID: "5c5f7454-c62e-479a-97d7-68468080eb78") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:20.881316 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.881192 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret podName:d91a8e46-100d-4354-8cf9-701190356708 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:28.881182121 +0000 UTC m=+18.725326133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret") pod "global-pull-secret-syncer-xbvhh" (UID: "d91a8e46-100d-4354-8cf9-701190356708") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:20.981872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:20.981835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:20.982052 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.982003 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:41:20.982052 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.982039 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:41:20.982052 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.982049 2575 projected.go:196] Error preparing data for projected volume kube-api-access-9thgd for pod openshift-network-diagnostics/network-check-target-8q5wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:20.982140 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:20.982098 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd podName:dbe0a188-b3ed-4c4a-9af4-98bd01e15f85 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:28.98208551 +0000 UTC m=+18.826229516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9thgd" (UniqueName: "kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd") pod "network-check-target-8q5wm" (UID: "dbe0a188-b3ed-4c4a-9af4-98bd01e15f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:21.335808 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:21.335718 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:21.336023 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:21.335724 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:21.336023 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:21.335920 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:21.336320 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:21.336103 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:22.336568 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:22.336520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:22.337050 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:22.336717 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:23.335645 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:23.335601 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:23.335645 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:23.335642 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:23.335909 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:23.335758 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:23.335909 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:23.335892 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:24.335724 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:24.335673 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:24.336177 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:24.335802 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:25.335212 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:25.335166 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:25.335212 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:25.335212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:25.335474 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:25.335340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:25.335517 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:25.335465 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:26.335875 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:26.335829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:26.336346 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:26.335968 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:27.335804 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:27.335766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:27.335804 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:27.335799 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:27.336278 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:27.335898 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:27.336278 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:27.336056 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:28.335768 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:28.335724 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:28.335997 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:28.335881 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:28.942715 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:28.942661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:28.942891 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:28.942731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:28.942891 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:28.942836 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:28.942891 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:28.942858 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:28.943065 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:28.942914 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret podName:d91a8e46-100d-4354-8cf9-701190356708 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:44.942894359 +0000 UTC m=+34.787038421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret") pod "global-pull-secret-syncer-xbvhh" (UID: "d91a8e46-100d-4354-8cf9-701190356708") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:28.943065 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:28.942933 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs podName:5c5f7454-c62e-479a-97d7-68468080eb78 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:44.94292266 +0000 UTC m=+34.787066672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs") pod "network-metrics-daemon-5pcvf" (UID: "5c5f7454-c62e-479a-97d7-68468080eb78") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:29.044139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:29.044093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:29.044376 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:29.044305 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:41:29.044376 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:29.044332 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:41:29.044376 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:29.044345 2575 projected.go:196] Error preparing data for projected volume kube-api-access-9thgd for pod openshift-network-diagnostics/network-check-target-8q5wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:29.044515 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:29.044419 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd podName:dbe0a188-b3ed-4c4a-9af4-98bd01e15f85 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:45.044396737 +0000 UTC m=+34.888540747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9thgd" (UniqueName: "kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd") pod "network-check-target-8q5wm" (UID: "dbe0a188-b3ed-4c4a-9af4-98bd01e15f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:29.335172 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:29.335122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:29.335172 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:29.335156 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:29.335500 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:29.335276 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:29.335500 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:29.335391 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:30.335048 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:30.334987 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:30.335634 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:30.335173 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:31.334820 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:31.334780 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:31.335045 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:31.334779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:31.335045 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:31.334905 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:31.335470 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:31.335042 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:32.338672 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.337750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:32.338672 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:32.338330 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:32.636960 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.636929 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"58472212bb1dfe9a2562c05cd5182119a5ded33e6d01947194dc7643bc2f1cc4"} Sep 17 17:41:32.637112 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.637063 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"05096761c5b50ad18c1367f12b8d05b7b61382d5d6cb8bd6c02b370a915a4014"} Sep 17 17:41:32.637112 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.637110 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"57ff874fa9d97c9d1744d0c34f0b7e978f41a35a29a1c7ec271c78270fa2dd92"} Sep 17 17:41:32.637230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.637142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"4ec6c9a5ab1c42c30c23f0b8ba2af98d2e27247504fb2ccf4cadda19e357aa23"} Sep 17 17:41:32.637230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.637187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"20abe457105953c443e9d4b6a724a6b3111c1316ba7044cf25548a5b8fd64ead"} Sep 17 17:41:32.638575 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.638547 2575 generic.go:356] "Generic (PLEG): container finished" podID="b69366f1-b9cc-445d-9925-e42f2b8cb129" containerID="dde5ce94ef7b110bdb15ac856bc9619885a4f526feec2a5cf330a6b670c3b6c4" exitCode=0 Sep 17 17:41:32.638691 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.638628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerDied","Data":"dde5ce94ef7b110bdb15ac856bc9619885a4f526feec2a5cf330a6b670c3b6c4"} Sep 17 17:41:32.640269 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.640247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pl5mt" event={"ID":"f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2","Type":"ContainerStarted","Data":"fb19e0a547e1f15efef5f4511d522c7c7592c9d7af36d0d9a6291ae737b7dfd3"} Sep 17 17:41:32.641879 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.641848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6s8cq" event={"ID":"62040b3e-71ad-4ee6-a954-853b6df70e6d","Type":"ContainerStarted","Data":"d4ffdfa849094cec0aa5b2629028824c9485132641bc39b1aa2924adf0f0965a"} Sep 17 17:41:32.643701 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.643678 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" event={"ID":"f50d1f52-3b82-440e-96d0-d8b26abd81c9","Type":"ContainerStarted","Data":"4c131f5680e40264135f7132677e24ff2a507fb221a55cf28b45f71a0ba20034"} Sep 17 17:41:32.645503 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.645475 2575 generic.go:356] "Generic (PLEG): container finished" podID="3060332f246039c5221c2c4d609002b7" containerID="e3fe4f7c49cfda87170141dab45477614bc161b3198f73a4537a5c4de5a3ebd3" exitCode=0 Sep 17 17:41:32.645618 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.645557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" event={"ID":"3060332f246039c5221c2c4d609002b7","Type":"ContainerDied","Data":"e3fe4f7c49cfda87170141dab45477614bc161b3198f73a4537a5c4de5a3ebd3"} Sep 17 17:41:32.647887 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.647722 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" event={"ID":"9c76f3be-34cb-4d05-bf7e-7fb1417a3380","Type":"ContainerStarted","Data":"e6ce6918a606a1fa0f57b00c0db5d2f660904cfd67e2f7cfef62b1de684037ba"} Sep 17 17:41:32.649371 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.649337 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lvjhz" event={"ID":"8e63fc9f-bfb4-44b2-9593-79bb966ab745","Type":"ContainerStarted","Data":"d83dba2c9a0e1faecebae614041ac8b2385d0ec45d6be01cebe8b46bca529fd7"} Sep 17 17:41:32.650815 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.650784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c4hnh" event={"ID":"3a0fc094-7d0a-4f58-b092-0931601d37f0","Type":"ContainerStarted","Data":"8ced312da114b42cdedf6df69976ee6162c549f37fe8caddd9d025235aafa0a3"} Sep 17 17:41:32.652220 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.652191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" event={"ID":"c5e35a777e08f96da9ac1513824707b6","Type":"ContainerStarted","Data":"0584b10bf17c6b0dc8485506937ae2bf7d48d5fe036373e0ebfec896ec1140ce"} Sep 17 17:41:32.652619 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.652601 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:32.665001 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.664958 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:41:32.665942 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.665915 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal"] Sep 17 17:41:32.712719 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.712623 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lvjhz" podStartSLOduration=2.572084901 podStartE2EDuration="20.712596312s" totalImagesPullingTime="18.140511411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:32.71211666 +0000 UTC m=+22.556260688" watchObservedRunningTime="2026-09-17 17:41:32.712596312 +0000 UTC m=+22.556740343" Sep 17 17:41:32.713120 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.713070 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c4hnh" podStartSLOduration=2.173438515 podStartE2EDuration="20.713054464s" totalImagesPullingTime="18.539615949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:32.695325965 +0000 UTC m=+22.539469994" watchObservedRunningTime="2026-09-17 17:41:32.713054464 +0000 UTC m=+22.557198499" Sep 17 17:41:32.733266 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.733211 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z5gkm" podStartSLOduration=2.566548369 podStartE2EDuration="20.733193892s" totalImagesPullingTime="18.166645523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:32.732573169 +0000 UTC m=+22.576717196" watchObservedRunningTime="2026-09-17 17:41:32.733193892 +0000 UTC m=+22.577337916" Sep 17 17:41:32.750025 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.749944 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6s8cq" podStartSLOduration=2.6632052980000003 podStartE2EDuration="20.749924132s" totalImagesPullingTime="18.086718834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:32.749884687 +0000 UTC m=+22.594028740" watchObservedRunningTime="2026-09-17 17:41:32.749924132 +0000 UTC m=+22.594068161" Sep 17 17:41:32.773315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:32.773253 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pl5mt" podStartSLOduration=2.637665134 podStartE2EDuration="20.773236628s" totalImagesPullingTime="18.135571494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:32.772877246 +0000 UTC m=+22.617021286" watchObservedRunningTime="2026-09-17 17:41:32.773236628 +0000 UTC m=+22.617380658" Sep 17 17:41:33.335947 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.335665 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:33.336242 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.335675 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:33.336242 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:33.336085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:33.336242 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:33.336161 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:33.390176 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.390147 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 17:41:33.656607 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.656565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" event={"ID":"3060332f246039c5221c2c4d609002b7","Type":"ContainerStarted","Data":"ed9d491de818e8cf4cb488a634b5c11fb311db6dfedb27423d2e4c892bd2b679"} Sep 17 17:41:33.658509 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.658462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x6tbh" event={"ID":"77b8deff-70f4-47b1-8d3b-618e91a26496","Type":"ContainerStarted","Data":"78ffdcef2f530c26fa96efe3f51a4b86ba9b90c76b9fa02470d252e360751d93"} Sep 17 17:41:33.662312 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.662277 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"86f9db9ca4446794cc3b582c49817def076e2348a7ffcbfc0aed84132531099a"} Sep 17 17:41:33.664603 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.664565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" event={"ID":"f50d1f52-3b82-440e-96d0-d8b26abd81c9","Type":"ContainerStarted","Data":"0543267378a77d1173836887939671663d0b75329c6d970040e4f65cd4473125"} Sep 17 17:41:33.665076 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.664905 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:33.674740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.674694 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:41:33.674911 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:33.674773 2575 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-71.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" Sep 17 17:41:33.689395 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.689160 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-71.ec2.internal" podStartSLOduration=1.689142758 podStartE2EDuration="1.689142758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:33.688771615 +0000 UTC m=+23.532915643" watchObservedRunningTime="2026-09-17 17:41:33.689142758 +0000 UTC m=+23.533286786" Sep 17 17:41:33.689609 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.689545 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-71.ec2.internal" podStartSLOduration=20.689533636 podStartE2EDuration="20.689533636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:33.675117917 +0000 UTC m=+23.519261944" watchObservedRunningTime="2026-09-17 17:41:33.689533636 +0000 UTC m=+23.533677664" Sep 17 17:41:33.705333 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:33.705263 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x6tbh" podStartSLOduration=3.645543369 podStartE2EDuration="21.70523602s" totalImagesPullingTime="18.059692651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:33.704177662 +0000 UTC m=+23.548321691" watchObservedRunningTime="2026-09-17 17:41:33.70523602 +0000 UTC m=+23.549380052" Sep 17 17:41:34.291126 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:34.290972 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:41:33.390167433Z","UUID":"580dec48-b543-4014-885a-5eae49b8ed6b","Handler":null,"Name":"","Endpoint":""} Sep 17 17:41:34.293151 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:34.293120 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 17:41:34.293340 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:34.293189 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 17:41:34.303928 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:34.303898 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6s8cq_62040b3e-71ad-4ee6-a954-853b6df70e6d/dns-node-resolver/0.log" Sep 17 17:41:34.335861 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:34.335827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:34.336136 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:34.335974 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:35.335154 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.335109 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:35.335621 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.335126 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:35.335621 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:35.335273 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:35.335621 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:35.335316 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:35.673212 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.673112 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"43123f38660a6afb2ff31f162932d01803a2ad43c3e83f823c8b88315f342a37"} Sep 17 17:41:35.675680 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.675646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" event={"ID":"f50d1f52-3b82-440e-96d0-d8b26abd81c9","Type":"ContainerStarted","Data":"3331ec67745d42e59d1bb89d0aab313ca96f027f5be5560b6d19369c85a9eec4"} Sep 17 17:41:35.685081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.685053 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pl5mt_f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2/node-ca/0.log" Sep 17 17:41:35.918434 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.918361 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:35.919077 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.919050 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:35.935316 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:35.935184 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7jft" podStartSLOduration=3.679890225 podStartE2EDuration="23.935156152s" totalImagesPullingTime="20.255265927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:35.697979219 +0000 UTC m=+25.542123249" watchObservedRunningTime="2026-09-17 17:41:35.935156152 +0000 UTC m=+25.779300181" Sep 17 17:41:36.335477 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:36.335435 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:36.335976 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:36.335584 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:36.678999 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:36.678959 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:36.679359 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:36.679339 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lvjhz" Sep 17 17:41:37.335219 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.334967 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:37.335434 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.334988 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:37.335434 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:37.335340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:37.335434 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:37.335373 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:37.685309 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.685218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" event={"ID":"4a809c26-8c16-4cfd-b368-b6fcec691758","Type":"ContainerStarted","Data":"c64c74c1c661536cf0f186d18b5ca075b13962b0ac2fd02316c105f52c62f310"} Sep 17 17:41:37.686131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.685441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:37.688092 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.688066 2575 generic.go:356] "Generic (PLEG): container finished" podID="b69366f1-b9cc-445d-9925-e42f2b8cb129" containerID="71f746b188368fc5924f228241c293803022a7a6a48d6af8400e4ada7053ca98" exitCode=0 Sep 17 17:41:37.688231 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.688161 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerDied","Data":"71f746b188368fc5924f228241c293803022a7a6a48d6af8400e4ada7053ca98"} Sep 17 17:41:37.705184 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.705151 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:37.715065 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:37.714994 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" podStartSLOduration=7.338040879 podStartE2EDuration="25.714979247s" totalImagesPullingTime="18.376938368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:37.7145469 +0000 UTC m=+27.558690927" watchObservedRunningTime="2026-09-17 17:41:37.714979247 +0000 UTC m=+27.559123274" Sep 17 17:41:38.335152 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:38.335107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:38.335337 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:38.335266 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:38.691406 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:38.691375 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:38.691927 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:38.691451 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:38.707481 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:38.707447 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:41:39.335214 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:39.335175 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:39.335384 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:39.335175 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:39.335384 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:39.335295 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:39.335474 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:39.335397 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:39.695141 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:39.695041 2575 generic.go:356] "Generic (PLEG): container finished" podID="b69366f1-b9cc-445d-9925-e42f2b8cb129" containerID="76c36e1ad6a354b1c0457db6f2e0b0c57dc44d3a78a3426d15f3fdf37931398e" exitCode=0 Sep 17 17:41:39.695141 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:39.695123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerDied","Data":"76c36e1ad6a354b1c0457db6f2e0b0c57dc44d3a78a3426d15f3fdf37931398e"} Sep 17 17:41:40.335175 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:40.335135 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:40.335394 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:40.335282 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:41.335714 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:41.335671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:41.335714 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:41.335707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:41.336322 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:41.335808 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:41.336322 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:41.335929 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:41.702344 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:41.702253 2575 generic.go:356] "Generic (PLEG): container finished" podID="b69366f1-b9cc-445d-9925-e42f2b8cb129" containerID="9e03f92ebea1921d9021ef2e02c4617711387010f2ced0cb9bd62f78b2e8b42e" exitCode=0 Sep 17 17:41:41.702344 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:41.702309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerDied","Data":"9e03f92ebea1921d9021ef2e02c4617711387010f2ced0cb9bd62f78b2e8b42e"} Sep 17 17:41:42.335803 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:42.335760 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:42.336367 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:42.335883 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:43.335705 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:43.335668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:43.335937 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:43.335672 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:43.335937 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:43.335816 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:43.335937 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:43.335865 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:44.335454 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:44.335412 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:44.335670 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:44.335551 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:44.971072 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:44.971031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:44.971072 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:44.971079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:44.971648 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:44.971203 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:44.971648 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:44.971277 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret podName:d91a8e46-100d-4354-8cf9-701190356708 nodeName:}" failed. No retries permitted until 2026-09-17 17:42:16.971256438 +0000 UTC m=+66.815400459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret") pod "global-pull-secret-syncer-xbvhh" (UID: "d91a8e46-100d-4354-8cf9-701190356708") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:41:44.971648 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:44.971203 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:44.971648 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:44.971336 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs podName:5c5f7454-c62e-479a-97d7-68468080eb78 nodeName:}" failed. No retries permitted until 2026-09-17 17:42:16.971324525 +0000 UTC m=+66.815468546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs") pod "network-metrics-daemon-5pcvf" (UID: "5c5f7454-c62e-479a-97d7-68468080eb78") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:41:45.072040 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:45.071980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:45.072257 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:45.072151 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:41:45.072257 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:45.072179 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:41:45.072257 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:45.072193 2575 projected.go:196] Error preparing data for projected volume kube-api-access-9thgd for pod openshift-network-diagnostics/network-check-target-8q5wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:45.072257 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:45.072254 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd podName:dbe0a188-b3ed-4c4a-9af4-98bd01e15f85 nodeName:}" failed. No retries permitted until 2026-09-17 17:42:17.07223725 +0000 UTC m=+66.916381258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9thgd" (UniqueName: "kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd") pod "network-check-target-8q5wm" (UID: "dbe0a188-b3ed-4c4a-9af4-98bd01e15f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:41:45.335642 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:45.335601 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:45.335642 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:45.335630 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:45.335917 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:45.335759 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:45.335917 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:45.335878 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:46.335583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:46.335206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:46.335583 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:46.335354 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:46.719400 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:46.719128 2575 generic.go:356] "Generic (PLEG): container finished" podID="b69366f1-b9cc-445d-9925-e42f2b8cb129" containerID="47b071f60c16f753c4670456821587f88aa7383e895aae9352b37dafe70ef7b5" exitCode=0 Sep 17 17:41:46.719400 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:46.719213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerDied","Data":"47b071f60c16f753c4670456821587f88aa7383e895aae9352b37dafe70ef7b5"} Sep 17 17:41:47.335063 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:47.335003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:47.335287 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:47.335003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:47.335287 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:47.335159 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:47.335287 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:47.335234 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:47.725466 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:47.725333 2575 generic.go:356] "Generic (PLEG): container finished" podID="b69366f1-b9cc-445d-9925-e42f2b8cb129" containerID="d409a8bf5e7d419afbbcac16cd2b9b696fbd221a157fd403f85ffb8bdf03b9e5" exitCode=0 Sep 17 17:41:47.725466 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:47.725398 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerDied","Data":"d409a8bf5e7d419afbbcac16cd2b9b696fbd221a157fd403f85ffb8bdf03b9e5"} Sep 17 17:41:48.335436 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:48.335394 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:48.335632 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:48.335514 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:48.734187 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:48.734084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" event={"ID":"b69366f1-b9cc-445d-9925-e42f2b8cb129","Type":"ContainerStarted","Data":"6ddb2e367541ea2977e25dc0053c3c970ead0747bb4c90496d6ac28a9710193a"} Sep 17 17:41:48.761402 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:48.759337 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j9bdn" podStartSLOduration=8.085483703 podStartE2EDuration="36.75931372s" totalImagesPullingTime="28.673830017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:48.757233317 +0000 UTC m=+38.601377345" watchObservedRunningTime="2026-09-17 17:41:48.75931372 +0000 UTC m=+38.603457749" Sep 17 17:41:49.335314 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:49.335265 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:49.335314 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:49.335295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:49.335577 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:49.335405 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:49.335577 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:49.335520 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:50.335607 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:50.335565 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:50.336042 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:50.335687 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:51.335365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:51.335322 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:51.335365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:51.335368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:51.335666 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:51.335447 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:51.335666 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:51.335587 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:52.335727 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:52.335688 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:52.336149 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:52.335803 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:53.335404 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:53.335358 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:53.335601 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:53.335381 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:53.335601 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:53.335498 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:53.335601 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:53.335538 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:54.335152 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:54.335114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:54.335582 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:54.335231 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:55.335071 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:55.335023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:55.335071 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:55.335070 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:55.335632 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:55.335162 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:55.335632 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:55.335298 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:56.336541 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:56.336502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:56.337038 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:56.336643 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:57.075116 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:57.074978 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xbvhh"] Sep 17 17:41:57.075347 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:57.075143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:57.075347 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:57.075276 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:41:57.078957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:57.078924 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8q5wm"] Sep 17 17:41:57.079167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:57.079093 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:57.079253 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:57.079229 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:57.079841 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:57.079802 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5pcvf"] Sep 17 17:41:57.079970 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:57.079917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:57.080080 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:57.080055 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:58.335978 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:58.335784 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:41:58.336435 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:58.335779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:41:58.336435 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:41:58.335836 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:41:58.336435 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:58.336092 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:41:58.336435 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:58.336221 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:41:58.336435 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:41:58.336308 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:42:00.335776 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:00.335733 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:42:00.336305 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:00.335738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:42:00.336305 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:42:00.335850 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xbvhh" podUID="d91a8e46-100d-4354-8cf9-701190356708" Sep 17 17:42:00.336305 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:42:00.335942 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5pcvf" podUID="5c5f7454-c62e-479a-97d7-68468080eb78" Sep 17 17:42:00.336305 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:00.335748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:42:00.336305 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:42:00.336049 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8q5wm" podUID="dbe0a188-b3ed-4c4a-9af4-98bd01e15f85" Sep 17 17:42:02.093154 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.093128 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-71.ec2.internal" event="NodeReady" Sep 17 17:42:02.093562 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.093258 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 17:42:02.170992 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.170954 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-82njx"] Sep 17 17:42:02.197559 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.197525 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-82njx"] Sep 17 17:42:02.197726 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.197660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.202281 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.202250 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 17:42:02.203000 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.202981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6n5jl\"" Sep 17 17:42:02.203124 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.203106 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 17:42:02.232924 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.232889 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x2cl2"] Sep 17 17:42:02.253713 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.253676 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wngkk"] Sep 17 17:42:02.253935 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.253832 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.257714 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.257683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xhmjd\"" Sep 17 17:42:02.258069 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.258045 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 17:42:02.258213 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.258073 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 17:42:02.258213 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.258119 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 17:42:02.265053 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.265026 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2cl2"] Sep 17 17:42:02.265179 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.265061 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wngkk"] Sep 17 17:42:02.265179 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.265094 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.267436 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.267410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zrqgb\"" Sep 17 17:42:02.267659 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.267643 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 17:42:02.267720 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.267710 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 17:42:02.267792 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.267775 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 17:42:02.268091 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.268076 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 17:42:02.290985 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.290949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dddc8f0-90c1-428d-a1bf-769187a32773-config-volume\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.291171 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.291033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dddc8f0-90c1-428d-a1bf-769187a32773-metrics-tls\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.291171 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.291057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dddc8f0-90c1-428d-a1bf-769187a32773-tmp-dir\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.291171 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.291077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x672m\" (UniqueName: \"kubernetes.io/projected/6dddc8f0-90c1-428d-a1bf-769187a32773-kube-api-access-x672m\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.336092 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.336053 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:42:02.336308 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.336130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:42:02.336308 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.336266 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:42:02.338406 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.338384 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:42:02.338575 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.338410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x7j64\"" Sep 17 17:42:02.338575 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.338453 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:42:02.338575 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.338546 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:42:02.338715 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.338662 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ccxk9\"" Sep 17 17:42:02.338752 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.338729 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:42:02.392296 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dddc8f0-90c1-428d-a1bf-769187a32773-metrics-tls\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.392296 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392291 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dddc8f0-90c1-428d-a1bf-769187a32773-tmp-dir\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.392553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x672m\" (UniqueName: \"kubernetes.io/projected/6dddc8f0-90c1-428d-a1bf-769187a32773-kube-api-access-x672m\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.392553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9bdj\" (UniqueName: \"kubernetes.io/projected/0e945ef4-334c-45cf-b21e-e55cf41c90d3-kube-api-access-h9bdj\") pod \"ingress-canary-x2cl2\" (UID: \"0e945ef4-334c-45cf-b21e-e55cf41c90d3\") " pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.392553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.392553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e945ef4-334c-45cf-b21e-e55cf41c90d3-cert\") pod \"ingress-canary-x2cl2\" (UID: \"0e945ef4-334c-45cf-b21e-e55cf41c90d3\") " pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.392553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.392553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqnjm\" (UniqueName: \"kubernetes.io/projected/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-kube-api-access-mqnjm\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.392553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dddc8f0-90c1-428d-a1bf-769187a32773-config-volume\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.392795 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-crio-socket\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.392795 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-data-volume\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.392795 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.392741 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dddc8f0-90c1-428d-a1bf-769187a32773-tmp-dir\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.393078 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.393063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dddc8f0-90c1-428d-a1bf-769187a32773-config-volume\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.396973 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.396951 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dddc8f0-90c1-428d-a1bf-769187a32773-metrics-tls\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.400857 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.400827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x672m\" (UniqueName: \"kubernetes.io/projected/6dddc8f0-90c1-428d-a1bf-769187a32773-kube-api-access-x672m\") pod \"dns-default-82njx\" (UID: \"6dddc8f0-90c1-428d-a1bf-769187a32773\") " pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.493037 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.492973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9bdj\" (UniqueName: \"kubernetes.io/projected/0e945ef4-334c-45cf-b21e-e55cf41c90d3-kube-api-access-h9bdj\") pod \"ingress-canary-x2cl2\" (UID: \"0e945ef4-334c-45cf-b21e-e55cf41c90d3\") " pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.493232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.493232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493196 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e945ef4-334c-45cf-b21e-e55cf41c90d3-cert\") pod \"ingress-canary-x2cl2\" (UID: \"0e945ef4-334c-45cf-b21e-e55cf41c90d3\") " pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.493348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.493348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqnjm\" (UniqueName: \"kubernetes.io/projected/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-kube-api-access-mqnjm\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.493348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-crio-socket\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.493479 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-data-volume\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.493528 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493493 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-crio-socket\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.493677 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.493738 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.493662 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-data-volume\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.495904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.495863 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.496109 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.496090 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e945ef4-334c-45cf-b21e-e55cf41c90d3-cert\") pod \"ingress-canary-x2cl2\" (UID: \"0e945ef4-334c-45cf-b21e-e55cf41c90d3\") " pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.503634 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.503579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9bdj\" (UniqueName: \"kubernetes.io/projected/0e945ef4-334c-45cf-b21e-e55cf41c90d3-kube-api-access-h9bdj\") pod \"ingress-canary-x2cl2\" (UID: \"0e945ef4-334c-45cf-b21e-e55cf41c90d3\") " pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.503859 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.503581 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqnjm\" (UniqueName: \"kubernetes.io/projected/2eaf22e0-8f5e-465b-a340-b8778eaa7bf2-kube-api-access-mqnjm\") pod \"insights-runtime-extractor-wngkk\" (UID: \"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2\") " pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.508471 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.508385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82njx" Sep 17 17:42:02.563567 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.563525 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2cl2" Sep 17 17:42:02.573196 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.573167 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wngkk" Sep 17 17:42:02.797043 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.796986 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-82njx"] Sep 17 17:42:02.800957 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:02.800922 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dddc8f0_90c1_428d_a1bf_769187a32773.slice/crio-cc949714c83a0a63b5e7d8105c4d619c0179227981bb0441b70400cfb76200d6 WatchSource:0}: Error finding container cc949714c83a0a63b5e7d8105c4d619c0179227981bb0441b70400cfb76200d6: Status 404 returned error can't find the container with id cc949714c83a0a63b5e7d8105c4d619c0179227981bb0441b70400cfb76200d6 Sep 17 17:42:02.845388 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.845354 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2cl2"] Sep 17 17:42:02.848863 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:02.848828 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e945ef4_334c_45cf_b21e_e55cf41c90d3.slice/crio-d5f14f53153ebd9c7e7425b8a981e883bbdcfd52c9fd65a3aeb755ccc80b39bf WatchSource:0}: Error finding container d5f14f53153ebd9c7e7425b8a981e883bbdcfd52c9fd65a3aeb755ccc80b39bf: Status 404 returned error can't find the container with id d5f14f53153ebd9c7e7425b8a981e883bbdcfd52c9fd65a3aeb755ccc80b39bf Sep 17 17:42:02.862899 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:02.862858 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wngkk"] Sep 17 17:42:02.867725 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:02.867693 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eaf22e0_8f5e_465b_a340_b8778eaa7bf2.slice/crio-59ccb253b089f71bad6b7ba59ff5404e5180244403375d3d8878b09e4b122934 WatchSource:0}: Error finding container 59ccb253b089f71bad6b7ba59ff5404e5180244403375d3d8878b09e4b122934: Status 404 returned error can't find the container with id 59ccb253b089f71bad6b7ba59ff5404e5180244403375d3d8878b09e4b122934 Sep 17 17:42:03.774960 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:03.774682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2cl2" event={"ID":"0e945ef4-334c-45cf-b21e-e55cf41c90d3","Type":"ContainerStarted","Data":"d5f14f53153ebd9c7e7425b8a981e883bbdcfd52c9fd65a3aeb755ccc80b39bf"} Sep 17 17:42:03.776737 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:03.776704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82njx" event={"ID":"6dddc8f0-90c1-428d-a1bf-769187a32773","Type":"ContainerStarted","Data":"cc949714c83a0a63b5e7d8105c4d619c0179227981bb0441b70400cfb76200d6"} Sep 17 17:42:03.779259 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:03.779215 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wngkk" event={"ID":"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2","Type":"ContainerStarted","Data":"8c38735e8ea0ed882cbcf64f3378c8c4a237d756554d57116e2593bfcbfbda51"} Sep 17 17:42:03.779455 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:03.779298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wngkk" event={"ID":"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2","Type":"ContainerStarted","Data":"59ccb253b089f71bad6b7ba59ff5404e5180244403375d3d8878b09e4b122934"} Sep 17 17:42:04.784330 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:04.784291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82njx" event={"ID":"6dddc8f0-90c1-428d-a1bf-769187a32773","Type":"ContainerStarted","Data":"3df476029fcb2b24824b6c99d25de66caae44e924a8e9a448de76707d24be430"} Sep 17 17:42:04.784885 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:04.784358 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82njx" event={"ID":"6dddc8f0-90c1-428d-a1bf-769187a32773","Type":"ContainerStarted","Data":"bc5f51d376548967fb3921729ad76ac34196e2482a3f65d9a4a393498ca87e41"} Sep 17 17:42:04.784885 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:04.784461 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-82njx" Sep 17 17:42:04.826026 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:04.825950 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-82njx" podStartSLOduration=1.219369847 podStartE2EDuration="2.825933204s" totalImagesPullingTime="1.606563357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:04.825419828 +0000 UTC m=+54.669563863" watchObservedRunningTime="2026-09-17 17:42:04.825933204 +0000 UTC m=+54.670077227" Sep 17 17:42:05.788534 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:05.788493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2cl2" event={"ID":"0e945ef4-334c-45cf-b21e-e55cf41c90d3","Type":"ContainerStarted","Data":"a4ac067962b2e214fac3a604491e40a641ba004d7d0cb3993c01924ce0012c80"} Sep 17 17:42:06.497085 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.496988 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x2cl2" podStartSLOduration=1.986025873 podStartE2EDuration="4.496959721s" totalImagesPullingTime="2.510933848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:05.807065452 +0000 UTC m=+55.651209485" watchObservedRunningTime="2026-09-17 17:42:06.496959721 +0000 UTC m=+56.341103752" Sep 17 17:42:06.497776 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.497749 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-847d48d9d6-ndjls"] Sep 17 17:42:06.501138 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.501110 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.505388 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.505358 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 17:42:06.505554 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.505425 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 17:42:06.509039 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.506563 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ksg57\"" Sep 17 17:42:06.509039 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.506582 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 17:42:06.509039 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.506890 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 17:42:06.509039 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.507079 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 17:42:06.509039 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.506564 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 17:42:06.509039 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.507692 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 17:42:06.512459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.512432 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847d48d9d6-ndjls"] Sep 17 17:42:06.630214 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.630181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-oauth-config\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.630214 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.630219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-oauth-serving-cert\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.630450 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.630248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-config\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.630450 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.630269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-service-ca\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.630450 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.630305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhv69\" (UniqueName: \"kubernetes.io/projected/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-kube-api-access-mhv69\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.630450 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.630368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-serving-cert\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.731240 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.731189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-serving-cert\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.731465 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.731298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-oauth-config\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.731465 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.731325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-oauth-serving-cert\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.731465 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.731350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-config\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.731465 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.731371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-service-ca\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.731465 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.731411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhv69\" (UniqueName: \"kubernetes.io/projected/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-kube-api-access-mhv69\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.732260 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.732233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-oauth-serving-cert\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.732260 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.732251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-config\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.732394 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.732234 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-service-ca\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.735302 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.735274 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-oauth-config\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.735373 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.735305 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-serving-cert\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.752047 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.751958 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhv69\" (UniqueName: \"kubernetes.io/projected/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-kube-api-access-mhv69\") pod \"console-847d48d9d6-ndjls\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:06.792874 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.792827 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wngkk" event={"ID":"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2","Type":"ContainerStarted","Data":"0b00bc3280e6fc9fa68f1a4d7f9f1103d28d6bc48cc436853b2a381da46a6893"} Sep 17 17:42:06.814382 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:06.814340 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:07.093895 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.093849 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847d48d9d6-ndjls"] Sep 17 17:42:07.098211 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:07.098167 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1f70fb_1cf8_4de8_9a36_aa9563cada15.slice/crio-420b2a43b665731ec88b31a2f2bb3d4b705234c23176cede31c5e77bace3cacf WatchSource:0}: Error finding container 420b2a43b665731ec88b31a2f2bb3d4b705234c23176cede31c5e77bace3cacf: Status 404 returned error can't find the container with id 420b2a43b665731ec88b31a2f2bb3d4b705234c23176cede31c5e77bace3cacf Sep 17 17:42:07.594096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.594052 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m"] Sep 17 17:42:07.603533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.603500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.621824 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.621790 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 17:42:07.622025 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.621794 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 17:42:07.622275 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.622255 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 17:42:07.622691 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.622670 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 17:42:07.632089 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.632055 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 17:42:07.632089 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.632055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nzqz4\"" Sep 17 17:42:07.634723 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.634692 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m"] Sep 17 17:42:07.739254 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.739206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/091557c3-ba28-4f7a-817b-b23d7bddfc73-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.739433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.739273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/091557c3-ba28-4f7a-817b-b23d7bddfc73-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.739433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.739324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/091557c3-ba28-4f7a-817b-b23d7bddfc73-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.739433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.739409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvkxs\" (UniqueName: \"kubernetes.io/projected/091557c3-ba28-4f7a-817b-b23d7bddfc73-kube-api-access-kvkxs\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.796833 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.796787 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d48d9d6-ndjls" event={"ID":"2f1f70fb-1cf8-4de8-9a36-aa9563cada15","Type":"ContainerStarted","Data":"420b2a43b665731ec88b31a2f2bb3d4b705234c23176cede31c5e77bace3cacf"} Sep 17 17:42:07.840176 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.840133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvkxs\" (UniqueName: \"kubernetes.io/projected/091557c3-ba28-4f7a-817b-b23d7bddfc73-kube-api-access-kvkxs\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.840358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.840226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/091557c3-ba28-4f7a-817b-b23d7bddfc73-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.840358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.840263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/091557c3-ba28-4f7a-817b-b23d7bddfc73-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.840358 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.840286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/091557c3-ba28-4f7a-817b-b23d7bddfc73-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.840905 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.840882 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/091557c3-ba28-4f7a-817b-b23d7bddfc73-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.843000 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.842973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/091557c3-ba28-4f7a-817b-b23d7bddfc73-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.843119 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.843086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/091557c3-ba28-4f7a-817b-b23d7bddfc73-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.864851 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.864824 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvkxs\" (UniqueName: \"kubernetes.io/projected/091557c3-ba28-4f7a-817b-b23d7bddfc73-kube-api-access-kvkxs\") pod \"prometheus-operator-7bd5d56d6-c9k4m\" (UID: \"091557c3-ba28-4f7a-817b-b23d7bddfc73\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:07.914854 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:07.914821 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" Sep 17 17:42:08.228172 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:08.228062 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m"] Sep 17 17:42:08.233234 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:08.233195 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091557c3_ba28_4f7a_817b_b23d7bddfc73.slice/crio-f23bcc03d1dec43af391f34f658f73432c27eab3b8747b48e60740ad659458ff WatchSource:0}: Error finding container f23bcc03d1dec43af391f34f658f73432c27eab3b8747b48e60740ad659458ff: Status 404 returned error can't find the container with id f23bcc03d1dec43af391f34f658f73432c27eab3b8747b48e60740ad659458ff Sep 17 17:42:08.802249 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:08.802207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" event={"ID":"091557c3-ba28-4f7a-817b-b23d7bddfc73","Type":"ContainerStarted","Data":"f23bcc03d1dec43af391f34f658f73432c27eab3b8747b48e60740ad659458ff"} Sep 17 17:42:08.804966 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:08.804934 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wngkk" event={"ID":"2eaf22e0-8f5e-465b-a340-b8778eaa7bf2","Type":"ContainerStarted","Data":"0a8164025ad4c43b3aa6ebd4bd9802953ac4f0017d324176dc11bad46d244d88"} Sep 17 17:42:08.828717 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:08.828611 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wngkk" podStartSLOduration=1.9611038170000001 podStartE2EDuration="6.828593153s" totalImagesPullingTime="4.867489336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:42:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:08.828392357 +0000 UTC m=+58.672536386" watchObservedRunningTime="2026-09-17 17:42:08.828593153 +0000 UTC m=+58.672737181" Sep 17 17:42:10.710076 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:10.709965 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6flgw" Sep 17 17:42:12.826655 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:12.826609 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" event={"ID":"091557c3-ba28-4f7a-817b-b23d7bddfc73","Type":"ContainerStarted","Data":"4e8001a4c6dd6cb44b65b6a1a6a175a78b5874679388cc4f4765b6bccb494bbc"} Sep 17 17:42:12.827298 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:12.826684 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" event={"ID":"091557c3-ba28-4f7a-817b-b23d7bddfc73","Type":"ContainerStarted","Data":"bb793432a712d36da09997ed57b741383be3093af32146da21a98777d63ae807"} Sep 17 17:42:12.828379 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:12.828347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d48d9d6-ndjls" event={"ID":"2f1f70fb-1cf8-4de8-9a36-aa9563cada15","Type":"ContainerStarted","Data":"6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f"} Sep 17 17:42:12.845432 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:12.845372 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-c9k4m" podStartSLOduration=2.243576642 podStartE2EDuration="5.845353575s" totalImagesPullingTime="3.601776933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:12.845057042 +0000 UTC m=+62.689201072" watchObservedRunningTime="2026-09-17 17:42:12.845353575 +0000 UTC m=+62.689497603" Sep 17 17:42:12.869261 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:12.869199 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-847d48d9d6-ndjls" podStartSLOduration=2.118854786 podStartE2EDuration="6.869181206s" totalImagesPullingTime="4.75032642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:12.86826319 +0000 UTC m=+62.712407220" watchObservedRunningTime="2026-09-17 17:42:12.869181206 +0000 UTC m=+62.713325234" Sep 17 17:42:14.082187 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.082152 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7887d7cb87-ssbbr"] Sep 17 17:42:14.085711 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.085685 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.093503 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.093476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-serving-cert\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.093620 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.093515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-oauth-config\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.093620 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.093559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-service-ca\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.093620 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.093611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-oauth-serving-cert\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.093752 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.093639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qb9\" (UniqueName: \"kubernetes.io/projected/03404759-ad40-4746-9ea4-936335e89090-kube-api-access-x4qb9\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.093752 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.093696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-trusted-ca-bundle\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.093752 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.093714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-console-config\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.098138 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.098105 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 17:42:14.099373 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.099346 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7887d7cb87-ssbbr"] Sep 17 17:42:14.195042 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.194965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-serving-cert\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.195042 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.195033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-oauth-config\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.195365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.195063 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-service-ca\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.195365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.195081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-oauth-serving-cert\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.195365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.195096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qb9\" (UniqueName: \"kubernetes.io/projected/03404759-ad40-4746-9ea4-936335e89090-kube-api-access-x4qb9\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.195365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.195159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-trusted-ca-bundle\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.195365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.195190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-console-config\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.196030 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.195978 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-service-ca\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.196159 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.196069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-trusted-ca-bundle\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.196159 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.196095 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-oauth-serving-cert\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.196159 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.196099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-console-config\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.197819 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.197788 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-oauth-config\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.197926 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.197903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-serving-cert\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.210648 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.210617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qb9\" (UniqueName: \"kubernetes.io/projected/03404759-ad40-4746-9ea4-936335e89090-kube-api-access-x4qb9\") pod \"console-7887d7cb87-ssbbr\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.395876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.395780 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:14.687214 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.687121 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7887d7cb87-ssbbr"] Sep 17 17:42:14.690492 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:14.690455 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03404759_ad40_4746_9ea4_936335e89090.slice/crio-98a7fa607f9d59dbb91adc2a405e51effdd2bbd156e289657cd236c8aa6abb90 WatchSource:0}: Error finding container 98a7fa607f9d59dbb91adc2a405e51effdd2bbd156e289657cd236c8aa6abb90: Status 404 returned error can't find the container with id 98a7fa607f9d59dbb91adc2a405e51effdd2bbd156e289657cd236c8aa6abb90 Sep 17 17:42:14.791626 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.791590 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-82njx" Sep 17 17:42:14.840034 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.839984 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7887d7cb87-ssbbr" event={"ID":"03404759-ad40-4746-9ea4-936335e89090","Type":"ContainerStarted","Data":"45f0b6995e0e50717b80de977bd5c0405fc43e57f154cfbd0f919139a76116ea"} Sep 17 17:42:14.840234 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.840059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7887d7cb87-ssbbr" event={"ID":"03404759-ad40-4746-9ea4-936335e89090","Type":"ContainerStarted","Data":"98a7fa607f9d59dbb91adc2a405e51effdd2bbd156e289657cd236c8aa6abb90"} Sep 17 17:42:14.875638 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:14.875583 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7887d7cb87-ssbbr" podStartSLOduration=0.8755682 podStartE2EDuration="875.5682ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:14.875329423 +0000 UTC m=+64.719473453" watchObservedRunningTime="2026-09-17 17:42:14.8755682 +0000 UTC m=+64.719712231" Sep 17 17:42:15.218067 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.218024 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2"] Sep 17 17:42:15.227847 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.227815 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.230805 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.230774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 17:42:15.231412 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.231385 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 17:42:15.232229 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.232212 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-w2xsn\"" Sep 17 17:42:15.281925 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.281882 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2"] Sep 17 17:42:15.304547 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.304504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf64ae51-8660-48c0-ac47-79a6e166d709-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.304547 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.304543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t77t\" (UniqueName: \"kubernetes.io/projected/cf64ae51-8660-48c0-ac47-79a6e166d709-kube-api-access-7t77t\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.304832 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.304572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf64ae51-8660-48c0-ac47-79a6e166d709-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.304832 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.304702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf64ae51-8660-48c0-ac47-79a6e166d709-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.307241 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.307211 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7vkwc"] Sep 17 17:42:15.317140 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.317107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.320111 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.320085 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qffnd\"" Sep 17 17:42:15.320264 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.320081 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 17:42:15.320264 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.320081 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 17:42:15.324211 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.324189 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 17:42:15.348742 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.348697 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-m4qw8"] Sep 17 17:42:15.359232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.359190 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.372243 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.372214 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 17:42:15.372423 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.372266 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 17:42:15.372423 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.372323 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 17:42:15.372423 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.372365 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kmhc7\"" Sep 17 17:42:15.390799 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.390757 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-m4qw8"] Sep 17 17:42:15.405347 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.405533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-root\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.405533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.405533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0096f40f-0f72-48f1-bb91-74477aa31902-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.405533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.405533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.405533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf64ae51-8660-48c0-ac47-79a6e166d709-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.405808 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t77t\" (UniqueName: \"kubernetes.io/projected/cf64ae51-8660-48c0-ac47-79a6e166d709-kube-api-access-7t77t\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.405808 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405582 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c05f47-5e76-4122-a090-b5e34da2608e-metrics-client-ca\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.405808 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mbzg\" (UniqueName: \"kubernetes.io/projected/0096f40f-0f72-48f1-bb91-74477aa31902-kube-api-access-4mbzg\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.405808 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h96zj\" (UniqueName: \"kubernetes.io/projected/b7c05f47-5e76-4122-a090-b5e34da2608e-kube-api-access-h96zj\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.405808 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-textfile\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.406081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-wtmp\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.406081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-tls\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.406081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf64ae51-8660-48c0-ac47-79a6e166d709-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.406081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-sys\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.406081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.406081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.405987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0096f40f-0f72-48f1-bb91-74477aa31902-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.406081 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.406036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf64ae51-8660-48c0-ac47-79a6e166d709-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.406649 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.406624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf64ae51-8660-48c0-ac47-79a6e166d709-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.408709 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.408680 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf64ae51-8660-48c0-ac47-79a6e166d709-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.409110 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.409093 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf64ae51-8660-48c0-ac47-79a6e166d709-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.430478 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.430441 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t77t\" (UniqueName: \"kubernetes.io/projected/cf64ae51-8660-48c0-ac47-79a6e166d709-kube-api-access-7t77t\") pod \"openshift-state-metrics-86c5bc79d6-95br2\" (UID: \"cf64ae51-8660-48c0-ac47-79a6e166d709\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.507329 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c05f47-5e76-4122-a090-b5e34da2608e-metrics-client-ca\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507329 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbzg\" (UniqueName: \"kubernetes.io/projected/0096f40f-0f72-48f1-bb91-74477aa31902-kube-api-access-4mbzg\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.507329 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h96zj\" (UniqueName: \"kubernetes.io/projected/b7c05f47-5e76-4122-a090-b5e34da2608e-kube-api-access-h96zj\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507329 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-textfile\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-wtmp\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-tls\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-sys\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507517 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.507695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507567 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-sys\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-wtmp\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.507695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0096f40f-0f72-48f1-bb91-74477aa31902-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507735 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-textfile\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-root\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7c05f47-5e76-4122-a090-b5e34da2608e-root\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0096f40f-0f72-48f1-bb91-74477aa31902-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507937 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.507993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0096f40f-0f72-48f1-bb91-74477aa31902-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.508096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.508075 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c05f47-5e76-4122-a090-b5e34da2608e-metrics-client-ca\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.508639 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.508466 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.508639 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.508560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0096f40f-0f72-48f1-bb91-74477aa31902-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.508639 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.508565 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.510392 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.510358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.510521 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.510366 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.510570 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.510553 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7c05f47-5e76-4122-a090-b5e34da2608e-node-exporter-tls\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.510831 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.510810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0096f40f-0f72-48f1-bb91-74477aa31902-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.517419 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.517390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h96zj\" (UniqueName: \"kubernetes.io/projected/b7c05f47-5e76-4122-a090-b5e34da2608e-kube-api-access-h96zj\") pod \"node-exporter-7vkwc\" (UID: \"b7c05f47-5e76-4122-a090-b5e34da2608e\") " pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.517594 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.517575 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mbzg\" (UniqueName: \"kubernetes.io/projected/0096f40f-0f72-48f1-bb91-74477aa31902-kube-api-access-4mbzg\") pod \"kube-state-metrics-84c885658c-m4qw8\" (UID: \"0096f40f-0f72-48f1-bb91-74477aa31902\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.537288 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.537251 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" Sep 17 17:42:15.627185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.627133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vkwc" Sep 17 17:42:15.646385 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:15.646355 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c05f47_5e76_4122_a090_b5e34da2608e.slice/crio-4e544e8bd56fe5cc52c211a67519f4d83abdcb3da4c165502d4ad6bf4b513d0e WatchSource:0}: Error finding container 4e544e8bd56fe5cc52c211a67519f4d83abdcb3da4c165502d4ad6bf4b513d0e: Status 404 returned error can't find the container with id 4e544e8bd56fe5cc52c211a67519f4d83abdcb3da4c165502d4ad6bf4b513d0e Sep 17 17:42:15.669367 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.669328 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" Sep 17 17:42:15.846716 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.846674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vkwc" event={"ID":"b7c05f47-5e76-4122-a090-b5e34da2608e","Type":"ContainerStarted","Data":"4e544e8bd56fe5cc52c211a67519f4d83abdcb3da4c165502d4ad6bf4b513d0e"} Sep 17 17:42:15.902281 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.902246 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2"] Sep 17 17:42:15.906265 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:15.906229 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf64ae51_8660_48c0_ac47_79a6e166d709.slice/crio-6a11c9c0a9b3f48a5f53b815d1815634bfab3bbf19611eda7b8e788c923ca47e WatchSource:0}: Error finding container 6a11c9c0a9b3f48a5f53b815d1815634bfab3bbf19611eda7b8e788c923ca47e: Status 404 returned error can't find the container with id 6a11c9c0a9b3f48a5f53b815d1815634bfab3bbf19611eda7b8e788c923ca47e Sep 17 17:42:15.964727 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:15.964444 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-m4qw8"] Sep 17 17:42:15.968823 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:15.968782 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0096f40f_0f72_48f1_bb91_74477aa31902.slice/crio-46ad8106ef550c7c9050cd78da2a96e4dfadad156990dd1181d346017448eec3 WatchSource:0}: Error finding container 46ad8106ef550c7c9050cd78da2a96e4dfadad156990dd1181d346017448eec3: Status 404 returned error can't find the container with id 46ad8106ef550c7c9050cd78da2a96e4dfadad156990dd1181d346017448eec3 Sep 17 17:42:16.224394 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.224350 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:42:16.243610 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.243567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.247061 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.246954 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.247892 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.248002 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.248309 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.248341 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.248523 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.248716 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pnvns\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.248777 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.248915 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:42:16.249362 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.249157 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:42:16.256151 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.254465 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:42:16.316404 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316404 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrnpq\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-kube-api-access-xrnpq\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-out\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316704 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-web-config\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.316904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.316882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.417854 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.417749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.417854 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.417795 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.417854 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.417822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrnpq\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-kube-api-access-xrnpq\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.417875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.417903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.417923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-out\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.417954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.418000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.418038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.418057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.418079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.418108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.418135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-web-config\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.418933 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.418900 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.419280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.419250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.419426 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.419323 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.421565 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.421454 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-web-config\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.422419 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.422158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.423156 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.423120 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.423304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.423273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.424240 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.423436 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.424240 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.423684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-out\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.424240 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.423785 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.424240 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.424202 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.424869 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.424847 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.429192 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.429166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrnpq\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-kube-api-access-xrnpq\") pod \"alertmanager-main-0\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.566600 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.566551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:42:16.814556 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.814514 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:16.814765 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.814596 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:16.820160 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.820130 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:16.853493 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.853454 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" event={"ID":"0096f40f-0f72-48f1-bb91-74477aa31902","Type":"ContainerStarted","Data":"46ad8106ef550c7c9050cd78da2a96e4dfadad156990dd1181d346017448eec3"} Sep 17 17:42:16.856546 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.856409 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" event={"ID":"cf64ae51-8660-48c0-ac47-79a6e166d709","Type":"ContainerStarted","Data":"04777487dc65659004907a5a1381e67b537f01cd9d83ab53dfbc9185f92a96b8"} Sep 17 17:42:16.856546 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.856480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" event={"ID":"cf64ae51-8660-48c0-ac47-79a6e166d709","Type":"ContainerStarted","Data":"57ef025e60f54165d54611cbcad63c08e8feaccd450bd98cf0784b51d555d160"} Sep 17 17:42:16.856546 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.856511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" event={"ID":"cf64ae51-8660-48c0-ac47-79a6e166d709","Type":"ContainerStarted","Data":"6a11c9c0a9b3f48a5f53b815d1815634bfab3bbf19611eda7b8e788c923ca47e"} Sep 17 17:42:16.862267 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:16.862168 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:42:17.013761 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.013584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:42:17.025225 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.025094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:42:17.025225 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.025195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:42:17.030029 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.029981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:42:17.030391 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.029981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:42:17.039329 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.039290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d91a8e46-100d-4354-8cf9-701190356708-original-pull-secret\") pod \"global-pull-secret-syncer-xbvhh\" (UID: \"d91a8e46-100d-4354-8cf9-701190356708\") " pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:42:17.039496 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.039355 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c5f7454-c62e-479a-97d7-68468080eb78-metrics-certs\") pod \"network-metrics-daemon-5pcvf\" (UID: \"5c5f7454-c62e-479a-97d7-68468080eb78\") " pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:42:17.054820 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.054782 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x7j64\"" Sep 17 17:42:17.057829 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.057790 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xbvhh" Sep 17 17:42:17.063503 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.063469 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5pcvf" Sep 17 17:42:17.126418 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.126371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:42:17.129095 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.129067 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:42:17.137207 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:17.137135 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825c90db_dd92_44cc_bfa4_0cd6720304f9.slice/crio-73ad79fa7780b23965e1d5fea59e2266b06f833c1cc955f350ea5292c56213df WatchSource:0}: Error finding container 73ad79fa7780b23965e1d5fea59e2266b06f833c1cc955f350ea5292c56213df: Status 404 returned error can't find the container with id 73ad79fa7780b23965e1d5fea59e2266b06f833c1cc955f350ea5292c56213df Sep 17 17:42:17.139656 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.139629 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:42:17.149531 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.149504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9thgd\" (UniqueName: \"kubernetes.io/projected/dbe0a188-b3ed-4c4a-9af4-98bd01e15f85-kube-api-access-9thgd\") pod \"network-check-target-8q5wm\" (UID: \"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85\") " pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:42:17.348793 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.348754 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ccxk9\"" Sep 17 17:42:17.357728 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.357691 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:42:17.738997 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.738913 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5pcvf"] Sep 17 17:42:17.743161 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:17.743091 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5f7454_c62e_479a_97d7_68468080eb78.slice/crio-e521101c976b08c8cd4d0d37d2bb4490aab266abf48961dd5e8b7b17295bd6aa WatchSource:0}: Error finding container e521101c976b08c8cd4d0d37d2bb4490aab266abf48961dd5e8b7b17295bd6aa: Status 404 returned error can't find the container with id e521101c976b08c8cd4d0d37d2bb4490aab266abf48961dd5e8b7b17295bd6aa Sep 17 17:42:17.745525 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.745230 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8q5wm"] Sep 17 17:42:17.750519 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:17.750466 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe0a188_b3ed_4c4a_9af4_98bd01e15f85.slice/crio-59542142cbd17646dd24a99a918369931945b6b8bc1ac26770e04728aacf6dbe WatchSource:0}: Error finding container 59542142cbd17646dd24a99a918369931945b6b8bc1ac26770e04728aacf6dbe: Status 404 returned error can't find the container with id 59542142cbd17646dd24a99a918369931945b6b8bc1ac26770e04728aacf6dbe Sep 17 17:42:17.755132 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.755095 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xbvhh"] Sep 17 17:42:17.759875 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:17.759843 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91a8e46_100d_4354_8cf9_701190356708.slice/crio-171ee2074ddabf31638d85dfd3bde693a00608eafd10a06d02b3b02e4ae82b0d WatchSource:0}: Error finding container 171ee2074ddabf31638d85dfd3bde693a00608eafd10a06d02b3b02e4ae82b0d: Status 404 returned error can't find the container with id 171ee2074ddabf31638d85dfd3bde693a00608eafd10a06d02b3b02e4ae82b0d Sep 17 17:42:17.863170 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.863060 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerStarted","Data":"73ad79fa7780b23965e1d5fea59e2266b06f833c1cc955f350ea5292c56213df"} Sep 17 17:42:17.864971 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.864932 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8q5wm" event={"ID":"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85","Type":"ContainerStarted","Data":"59542142cbd17646dd24a99a918369931945b6b8bc1ac26770e04728aacf6dbe"} Sep 17 17:42:17.866589 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.866514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5pcvf" event={"ID":"5c5f7454-c62e-479a-97d7-68468080eb78","Type":"ContainerStarted","Data":"e521101c976b08c8cd4d0d37d2bb4490aab266abf48961dd5e8b7b17295bd6aa"} Sep 17 17:42:17.868565 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.868529 2575 generic.go:356] "Generic (PLEG): container finished" podID="b7c05f47-5e76-4122-a090-b5e34da2608e" containerID="85d1d3ae42ad4f3c2b5c5a35ed2919065fdaf76ad879523e7abedc4d3daa86c3" exitCode=0 Sep 17 17:42:17.868722 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.868627 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vkwc" event={"ID":"b7c05f47-5e76-4122-a090-b5e34da2608e","Type":"ContainerDied","Data":"85d1d3ae42ad4f3c2b5c5a35ed2919065fdaf76ad879523e7abedc4d3daa86c3"} Sep 17 17:42:17.871556 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.871467 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" event={"ID":"0096f40f-0f72-48f1-bb91-74477aa31902","Type":"ContainerStarted","Data":"6ee36ce1b3c69c2754e19fa388fc6c512e7ef6a143b692778db51fbd31198188"} Sep 17 17:42:17.871556 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.871539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" event={"ID":"0096f40f-0f72-48f1-bb91-74477aa31902","Type":"ContainerStarted","Data":"4f346d15ce3becf57807a1546e656fcb867f926931ed67ef55ac9873d7ae21ab"} Sep 17 17:42:17.871735 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.871565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" event={"ID":"0096f40f-0f72-48f1-bb91-74477aa31902","Type":"ContainerStarted","Data":"82a5a554e60a3e75ad85000c931b65174a0d383b7fe74d19318e07d9d2797362"} Sep 17 17:42:17.874631 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.874579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" event={"ID":"cf64ae51-8660-48c0-ac47-79a6e166d709","Type":"ContainerStarted","Data":"31240091087ef07424254df3c23abc8b58bbf57ea3a2ada140be68d1477f130b"} Sep 17 17:42:17.876310 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.876265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xbvhh" event={"ID":"d91a8e46-100d-4354-8cf9-701190356708","Type":"ContainerStarted","Data":"171ee2074ddabf31638d85dfd3bde693a00608eafd10a06d02b3b02e4ae82b0d"} Sep 17 17:42:17.941379 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.941320 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-95br2" podStartSLOduration=1.695780514 podStartE2EDuration="2.941298488s" totalImagesPullingTime="1.245517974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:17.941258159 +0000 UTC m=+67.785402192" watchObservedRunningTime="2026-09-17 17:42:17.941298488 +0000 UTC m=+67.785442516" Sep 17 17:42:17.970895 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:17.970822 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-m4qw8" podStartSLOduration=1.5365386380000001 podStartE2EDuration="2.970796935s" totalImagesPullingTime="1.434258297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:17.969623602 +0000 UTC m=+67.813767633" watchObservedRunningTime="2026-09-17 17:42:17.970796935 +0000 UTC m=+67.814940965" Sep 17 17:42:18.335637 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.334710 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf"] Sep 17 17:42:18.339800 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.338121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.341699 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.341504 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ftt8k\"" Sep 17 17:42:18.343948 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.343740 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 17:42:18.344138 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.344036 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 17:42:18.345045 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.344787 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-691171i86h7a1\"" Sep 17 17:42:18.345045 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.344998 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 17:42:18.345258 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.345066 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 17:42:18.345329 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.345314 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 17:42:18.362542 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.362388 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf"] Sep 17 17:42:18.441643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649b0484-b3d4-4ab1-815d-928a5e676441-metrics-client-ca\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.441643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.441643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-grpc-tls\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.441643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.441643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.441643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.442176 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-tls\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.442176 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.441729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w9x7\" (UniqueName: \"kubernetes.io/projected/649b0484-b3d4-4ab1-815d-928a5e676441-kube-api-access-8w9x7\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649b0484-b3d4-4ab1-815d-928a5e676441-metrics-client-ca\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-grpc-tls\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-tls\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.543088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.542952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w9x7\" (UniqueName: \"kubernetes.io/projected/649b0484-b3d4-4ab1-815d-928a5e676441-kube-api-access-8w9x7\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.544312 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.543618 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649b0484-b3d4-4ab1-815d-928a5e676441-metrics-client-ca\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.547315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.547252 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.547315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.547286 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-grpc-tls\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.548229 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.548197 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.549961 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.549930 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.551169 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.551117 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.551419 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.551392 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/649b0484-b3d4-4ab1-815d-928a5e676441-secret-thanos-querier-tls\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.561064 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.560977 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w9x7\" (UniqueName: \"kubernetes.io/projected/649b0484-b3d4-4ab1-815d-928a5e676441-kube-api-access-8w9x7\") pod \"thanos-querier-5f54c5d9fb-mbbzf\" (UID: \"649b0484-b3d4-4ab1-815d-928a5e676441\") " pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.669891 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.669852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:18.892024 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.891959 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vkwc" event={"ID":"b7c05f47-5e76-4122-a090-b5e34da2608e","Type":"ContainerStarted","Data":"3d6087616a04c55c57cb454688124ae4e953dd84fc473dd719ba1a2092932a61"} Sep 17 17:42:18.893535 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.892710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vkwc" event={"ID":"b7c05f47-5e76-4122-a090-b5e34da2608e","Type":"ContainerStarted","Data":"aab9497b04db5a8826142f8e90cbb5bd8bb7e6a86542750670ba59d6fd999e33"} Sep 17 17:42:18.895029 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.894975 2575 generic.go:356] "Generic (PLEG): container finished" podID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerID="d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d" exitCode=0 Sep 17 17:42:18.895870 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.895815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d"} Sep 17 17:42:18.940155 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:18.940071 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7vkwc" podStartSLOduration=2.760112903 podStartE2EDuration="3.939998322s" totalImagesPullingTime="1.100819502s" totalInitContainerRuntime="79.065917ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:18.937112067 +0000 UTC m=+68.781256099" watchObservedRunningTime="2026-09-17 17:42:18.939998322 +0000 UTC m=+68.784142351" Sep 17 17:42:19.260464 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.260350 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf"] Sep 17 17:42:19.264178 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:19.264138 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649b0484_b3d4_4ab1_815d_928a5e676441.slice/crio-9ef79379db736d386c0d421912e52442691324d5a9af6f6714befabb90c69857 WatchSource:0}: Error finding container 9ef79379db736d386c0d421912e52442691324d5a9af6f6714befabb90c69857: Status 404 returned error can't find the container with id 9ef79379db736d386c0d421912e52442691324d5a9af6f6714befabb90c69857 Sep 17 17:42:19.770822 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.770294 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-sn442"] Sep 17 17:42:19.773196 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.773166 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:19.777974 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.777698 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nn4p9\"" Sep 17 17:42:19.777974 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.777801 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 17:42:19.784923 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.784894 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-sn442"] Sep 17 17:42:19.857766 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.857712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46qqn\" (UniqueName: \"kubernetes.io/projected/e77eafce-5037-453d-b6b4-130343900637-kube-api-access-46qqn\") pod \"monitoring-plugin-5984459ff8-sn442\" (UID: \"e77eafce-5037-453d-b6b4-130343900637\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:19.858068 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.857883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e77eafce-5037-453d-b6b4-130343900637-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-sn442\" (UID: \"e77eafce-5037-453d-b6b4-130343900637\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:19.909314 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.909162 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" event={"ID":"649b0484-b3d4-4ab1-815d-928a5e676441","Type":"ContainerStarted","Data":"9ef79379db736d386c0d421912e52442691324d5a9af6f6714befabb90c69857"} Sep 17 17:42:19.912830 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.912783 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5pcvf" event={"ID":"5c5f7454-c62e-479a-97d7-68468080eb78","Type":"ContainerStarted","Data":"971652a5925c5fdc862c33df5e63bae39c3039f1eb0f4cc78579c80cf3a1b149"} Sep 17 17:42:19.913045 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.912855 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5pcvf" event={"ID":"5c5f7454-c62e-479a-97d7-68468080eb78","Type":"ContainerStarted","Data":"fb5a8b096926a1760beb97025915c1445396145e69c0e158c8db78a272348ed0"} Sep 17 17:42:19.930144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.928320 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7887d7cb87-ssbbr"] Sep 17 17:42:19.944538 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.942842 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4"] Sep 17 17:42:19.947125 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.945986 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:19.949991 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.949957 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 17:42:19.950316 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.950294 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 17:42:19.951567 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.950526 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 17:42:19.951567 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.950765 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bjzqg\"" Sep 17 17:42:19.951567 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.951102 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9kqdhppf6pc19\"" Sep 17 17:42:19.951567 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.951376 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 17:42:19.959046 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.958533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e77eafce-5037-453d-b6b4-130343900637-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-sn442\" (UID: \"e77eafce-5037-453d-b6b4-130343900637\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:19.959046 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.958608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qqn\" (UniqueName: \"kubernetes.io/projected/e77eafce-5037-453d-b6b4-130343900637-kube-api-access-46qqn\") pod \"monitoring-plugin-5984459ff8-sn442\" (UID: \"e77eafce-5037-453d-b6b4-130343900637\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:19.960308 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:42:19.959439 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 17:42:19.960308 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:42:19.959521 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77eafce-5037-453d-b6b4-130343900637-monitoring-plugin-cert podName:e77eafce-5037-453d-b6b4-130343900637 nodeName:}" failed. No retries permitted until 2026-09-17 17:42:20.459495721 +0000 UTC m=+70.303639742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e77eafce-5037-453d-b6b4-130343900637-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-sn442" (UID: "e77eafce-5037-453d-b6b4-130343900637") : secret "monitoring-plugin-cert" not found Sep 17 17:42:19.961904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.961443 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5pcvf" podStartSLOduration=66.716662411 podStartE2EDuration="1m7.961421077s" totalImagesPullingTime="1.244758666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:19.960701569 +0000 UTC m=+69.804845599" watchObservedRunningTime="2026-09-17 17:42:19.961421077 +0000 UTC m=+69.805565107" Sep 17 17:42:19.961904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.961827 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4"] Sep 17 17:42:19.975862 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.974215 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54bdfb7bb8-rxhm7"] Sep 17 17:42:19.977295 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.977265 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:19.982782 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.982743 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46qqn\" (UniqueName: \"kubernetes.io/projected/e77eafce-5037-453d-b6b4-130343900637-kube-api-access-46qqn\") pod \"monitoring-plugin-5984459ff8-sn442\" (UID: \"e77eafce-5037-453d-b6b4-130343900637\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:19.997946 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:19.997818 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bdfb7bb8-rxhm7"] Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.059790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-secret-metrics-server-tls\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.059891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-config\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.059924 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-oauth-serving-cert\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.059966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ed832fe-1e93-4c8b-8529-59ad38124cb2-metrics-server-audit-profiles\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed832fe-1e93-4c8b-8529-59ad38124cb2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ed832fe-1e93-4c8b-8529-59ad38124cb2-audit-log\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-oauth-config\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-service-ca\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-trusted-ca-bundle\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-secret-metrics-server-client-certs\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-client-ca-bundle\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.060315 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-serving-cert\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.061044 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzsmp\" (UniqueName: \"kubernetes.io/projected/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-kube-api-access-bzsmp\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.061044 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.060372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq42z\" (UniqueName: \"kubernetes.io/projected/9ed832fe-1e93-4c8b-8529-59ad38124cb2-kube-api-access-pq42z\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161123 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161071 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ed832fe-1e93-4c8b-8529-59ad38124cb2-metrics-server-audit-profiles\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161351 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed832fe-1e93-4c8b-8529-59ad38124cb2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161351 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ed832fe-1e93-4c8b-8529-59ad38124cb2-audit-log\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161351 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-oauth-config\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.161351 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-service-ca\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.161351 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-trusted-ca-bundle\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.161351 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-secret-metrics-server-client-certs\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161351 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-client-ca-bundle\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-serving-cert\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.161689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzsmp\" (UniqueName: \"kubernetes.io/projected/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-kube-api-access-bzsmp\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.161689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161481 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq42z\" (UniqueName: \"kubernetes.io/projected/9ed832fe-1e93-4c8b-8529-59ad38124cb2-kube-api-access-pq42z\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161534 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-secret-metrics-server-tls\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.161689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-config\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.161689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.161601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-oauth-serving-cert\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.162337 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.162306 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ed832fe-1e93-4c8b-8529-59ad38124cb2-metrics-server-audit-profiles\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.162434 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.162363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-oauth-serving-cert\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.162961 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.162930 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed832fe-1e93-4c8b-8529-59ad38124cb2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.163595 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.163563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-service-ca\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.163752 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.163543 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ed832fe-1e93-4c8b-8529-59ad38124cb2-audit-log\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.163820 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.163794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-config\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.164707 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.164680 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-trusted-ca-bundle\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.167688 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.167623 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-oauth-config\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.167862 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.167708 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-client-ca-bundle\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.168566 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.168508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-secret-metrics-server-client-certs\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.170522 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.170447 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ed832fe-1e93-4c8b-8529-59ad38124cb2-secret-metrics-server-tls\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.170674 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.170646 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-serving-cert\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.179582 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.179540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq42z\" (UniqueName: \"kubernetes.io/projected/9ed832fe-1e93-4c8b-8529-59ad38124cb2-kube-api-access-pq42z\") pod \"metrics-server-56c8f5fbb4-l7kl4\" (UID: \"9ed832fe-1e93-4c8b-8529-59ad38124cb2\") " pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.179856 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.179806 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzsmp\" (UniqueName: \"kubernetes.io/projected/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-kube-api-access-bzsmp\") pod \"console-54bdfb7bb8-rxhm7\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.269465 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.269080 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:20.309690 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.309324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:20.465259 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.465199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e77eafce-5037-453d-b6b4-130343900637-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-sn442\" (UID: \"e77eafce-5037-453d-b6b4-130343900637\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:20.468946 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.468905 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e77eafce-5037-453d-b6b4-130343900637-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-sn442\" (UID: \"e77eafce-5037-453d-b6b4-130343900637\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:20.669744 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.669649 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56bfbb9478-j9f57"] Sep 17 17:42:20.674317 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.674284 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.677797 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.677765 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 17:42:20.678001 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.677975 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 17:42:20.678090 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.678042 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 17:42:20.678249 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.678216 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 17:42:20.678305 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.678249 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 17:42:20.678480 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.678461 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8b2rw\"" Sep 17 17:42:20.691975 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.691938 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56bfbb9478-j9f57"] Sep 17 17:42:20.692188 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.692040 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:20.695611 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.695578 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 17:42:20.768282 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-telemeter-client-tls\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.768494 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-metrics-client-ca\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.768494 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnwq5\" (UniqueName: \"kubernetes.io/projected/cf972848-6f27-4f21-a60a-a45fb0b1949e-kube-api-access-rnwq5\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.768749 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-serving-certs-ca-bundle\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.768749 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.768749 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-federate-client-tls\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.768749 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-secret-telemeter-client\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.768749 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.768652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.869584 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-telemeter-client-tls\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-metrics-client-ca\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnwq5\" (UniqueName: \"kubernetes.io/projected/cf972848-6f27-4f21-a60a-a45fb0b1949e-kube-api-access-rnwq5\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-serving-certs-ca-bundle\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-federate-client-tls\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-secret-telemeter-client\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.869832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870634 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.870577 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-metrics-client-ca\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.870836 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.870802 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-serving-certs-ca-bundle\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.871541 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.871512 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf972848-6f27-4f21-a60a-a45fb0b1949e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.872686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.872662 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-federate-client-tls\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.872764 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.872749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-telemeter-client-tls\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.872892 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.872870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.873373 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.873349 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cf972848-6f27-4f21-a60a-a45fb0b1949e-secret-telemeter-client\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.881699 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.881628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnwq5\" (UniqueName: \"kubernetes.io/projected/cf972848-6f27-4f21-a60a-a45fb0b1949e-kube-api-access-rnwq5\") pod \"telemeter-client-56bfbb9478-j9f57\" (UID: \"cf972848-6f27-4f21-a60a-a45fb0b1949e\") " pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:20.988590 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:20.988483 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" Sep 17 17:42:21.715913 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.715853 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:42:21.721861 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.721830 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.727217 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.727172 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 17:42:21.727659 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.727501 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 17:42:21.731935 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.730827 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 17:42:21.731935 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.730947 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 17:42:21.731935 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.731421 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 17:42:21.731935 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.731463 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 17:42:21.731935 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.731645 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 17:42:21.731935 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.730987 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 17:42:21.732706 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.732023 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 17:42:21.732706 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.732040 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxkbd\"" Sep 17 17:42:21.732706 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.732088 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 17:42:21.732706 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.732098 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 17:42:21.732706 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.732271 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ns9sl8ais05s\"" Sep 17 17:42:21.732706 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.732489 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 17:42:21.736708 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.736670 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 17:42:21.742997 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.740581 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 17:42:21.745595 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.745452 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:42:21.779474 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779474 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779922 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779922 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.779922 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780055 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780055 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.779999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c427q\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-kube-api-access-c427q\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780055 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780161 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780161 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780161 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780161 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780307 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780307 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780307 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.780433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.780326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.881624 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.881985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.882196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.882739 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.882714 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.883845 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.882901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.883845 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.883123 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.883845 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.883665 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.883864 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.883889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.883962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.884004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.884056 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.884084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884401 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.884154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884401 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.884187 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884401 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.884217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c427q\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-kube-api-access-c427q\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.884401 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.884253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.885393 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.885353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.885739 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.885713 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.886196 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.885839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.886846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.886754 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.887177 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.887153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.887525 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.887496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.887694 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.887671 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.888374 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.888351 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.888801 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.888776 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.889023 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.888959 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.889136 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.889074 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.890189 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.890165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.890295 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.890249 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:21.901985 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:21.901954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c427q\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-kube-api-access-c427q\") pod \"prometheus-k8s-0\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:22.036708 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:22.036622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:23.940335 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:23.940221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerStarted","Data":"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa"} Sep 17 17:42:23.943493 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:23.943335 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" event={"ID":"649b0484-b3d4-4ab1-815d-928a5e676441","Type":"ContainerStarted","Data":"bdf1ddfaf26f4c807669a5b70e723a9f93edff19099974266bd89a7452ac0f7e"} Sep 17 17:42:23.946786 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:23.946527 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:42:23.973033 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:23.972913 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8q5wm" podStartSLOduration=65.959270127 podStartE2EDuration="1m11.972893895s" totalImagesPullingTime="6.013623768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:23.972069655 +0000 UTC m=+73.816213685" watchObservedRunningTime="2026-09-17 17:42:23.972893895 +0000 UTC m=+73.817037924" Sep 17 17:42:24.094686 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.094447 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4"] Sep 17 17:42:24.098205 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.097946 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56bfbb9478-j9f57"] Sep 17 17:42:24.118660 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.117522 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bdfb7bb8-rxhm7"] Sep 17 17:42:24.125060 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.124702 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-sn442"] Sep 17 17:42:24.125216 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.125070 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:42:24.396088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.395998 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:24.956265 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.956219 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" event={"ID":"cf972848-6f27-4f21-a60a-a45fb0b1949e","Type":"ContainerStarted","Data":"469e369dabcae0f4cf7613d005ed612aca5a1811b0f0baacce94baf735b1b41a"} Sep 17 17:42:24.959377 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.959319 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" event={"ID":"9ed832fe-1e93-4c8b-8529-59ad38124cb2","Type":"ContainerStarted","Data":"b4cb0c3cc826fa5d250b48e294f301f19f55427b5a9b19c1db688421e1941f21"} Sep 17 17:42:24.963460 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.961730 2575 generic.go:356] "Generic (PLEG): container finished" podID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" exitCode=0 Sep 17 17:42:24.963460 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.961869 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0"} Sep 17 17:42:24.963460 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.961951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerStarted","Data":"f063c20869f9a1ccb1ef5bcd921df0759b1d2fd1ffd772e00f9312980fe1ef92"} Sep 17 17:42:24.965785 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.965692 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" event={"ID":"e77eafce-5037-453d-b6b4-130343900637","Type":"ContainerStarted","Data":"bd8cd62775a1c982a763da7ad9e8e83e142504b236cee7187257ae64ad8f7489"} Sep 17 17:42:24.970245 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.970057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" event={"ID":"649b0484-b3d4-4ab1-815d-928a5e676441","Type":"ContainerStarted","Data":"23a48e27d2184b292ea4395cd40b6999fdc27d6a00e0eb2168045f2daeeb6e6b"} Sep 17 17:42:24.970245 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.970146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" event={"ID":"649b0484-b3d4-4ab1-815d-928a5e676441","Type":"ContainerStarted","Data":"11f0f953e6c9fee94774ec4c40da15bf2fc73d0a4bce42ec0668e18d4af0f142"} Sep 17 17:42:24.970245 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.970195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" event={"ID":"649b0484-b3d4-4ab1-815d-928a5e676441","Type":"ContainerStarted","Data":"ada6cc657629254d87eda46d8211e97adeebc1420f48eef9913a14ca0e081a84"} Sep 17 17:42:24.973782 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.973202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bdfb7bb8-rxhm7" event={"ID":"f2986cb0-1eaf-457a-bfcc-8d298b0322c4","Type":"ContainerStarted","Data":"e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9"} Sep 17 17:42:24.973782 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.973252 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bdfb7bb8-rxhm7" event={"ID":"f2986cb0-1eaf-457a-bfcc-8d298b0322c4","Type":"ContainerStarted","Data":"3846803a6043778dd4e17bc76bd62739d4958e670cf0918e974b183383d77c7b"} Sep 17 17:42:24.981022 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.980657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerStarted","Data":"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172"} Sep 17 17:42:24.981022 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.980811 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerStarted","Data":"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757"} Sep 17 17:42:24.981022 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.980864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerStarted","Data":"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483"} Sep 17 17:42:24.981022 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.980906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerStarted","Data":"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3"} Sep 17 17:42:24.981022 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.980950 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerStarted","Data":"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df"} Sep 17 17:42:24.984302 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.984221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8q5wm" event={"ID":"dbe0a188-b3ed-4c4a-9af4-98bd01e15f85","Type":"ContainerStarted","Data":"c686be261da108a51650a77a2373e18e162525a25b651bac4992c6031f6426bf"} Sep 17 17:42:24.987403 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:24.987367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xbvhh" event={"ID":"d91a8e46-100d-4354-8cf9-701190356708","Type":"ContainerStarted","Data":"f456c056f3bf7f39da94fc08abdea4a9027f4770d811545da0fba9ba2b6731c2"} Sep 17 17:42:25.075554 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:25.075298 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54bdfb7bb8-rxhm7" podStartSLOduration=6.075275108 podStartE2EDuration="6.075275108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:25.074689974 +0000 UTC m=+74.918834005" watchObservedRunningTime="2026-09-17 17:42:25.075275108 +0000 UTC m=+74.919419140" Sep 17 17:42:25.077059 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:25.076959 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xbvhh" podStartSLOduration=67.061553397 podStartE2EDuration="1m13.076939448s" totalImagesPullingTime="6.015386051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:25.055633663 +0000 UTC m=+74.899777693" watchObservedRunningTime="2026-09-17 17:42:25.076939448 +0000 UTC m=+74.921083479" Sep 17 17:42:25.111212 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:25.110523 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.607661929 podStartE2EDuration="9.11048235s" totalImagesPullingTime="6.477222138s" totalInitContainerRuntime="25.598283ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:25.107952846 +0000 UTC m=+74.952096875" watchObservedRunningTime="2026-09-17 17:42:25.11048235 +0000 UTC m=+74.954626380" Sep 17 17:42:25.998522 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:25.998316 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" event={"ID":"649b0484-b3d4-4ab1-815d-928a5e676441","Type":"ContainerStarted","Data":"9caa753f3afa5359c0786359a4bacce968a3ba0039737a49ef6bb3daa10117f8"} Sep 17 17:42:25.998522 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:25.998408 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" event={"ID":"649b0484-b3d4-4ab1-815d-928a5e676441","Type":"ContainerStarted","Data":"cadcf909aab97c95f7294115f23ce1aa6b90f38499ec83f4d1408e97e8896b61"} Sep 17 17:42:25.999181 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:25.998973 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:26.032128 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:26.032055 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" podStartSLOduration=2.803646461 podStartE2EDuration="8.032028745s" totalImagesPullingTime="5.228382284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:26.031727662 +0000 UTC m=+75.875871692" watchObservedRunningTime="2026-09-17 17:42:26.032028745 +0000 UTC m=+75.876172776" Sep 17 17:42:27.006478 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.006434 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" event={"ID":"cf972848-6f27-4f21-a60a-a45fb0b1949e","Type":"ContainerStarted","Data":"82f61e3fcc815f43e1ae2d2eeb7fbc4ccd1dcb9720a13c4d661e65cd1cb63820"} Sep 17 17:42:27.006957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.006516 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" event={"ID":"cf972848-6f27-4f21-a60a-a45fb0b1949e","Type":"ContainerStarted","Data":"427fc5a9978660a8852edaf523f0fe427dbf28ea6d50be80c093e56b8f0e422f"} Sep 17 17:42:27.006957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.006542 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" event={"ID":"cf972848-6f27-4f21-a60a-a45fb0b1949e","Type":"ContainerStarted","Data":"36d491ec442a06941152e0d34ffda2e40ce1a95438ae6d305948452290715af1"} Sep 17 17:42:27.009074 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.009030 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" event={"ID":"9ed832fe-1e93-4c8b-8529-59ad38124cb2","Type":"ContainerStarted","Data":"6ea8134daa7ccd99c76e5c031d41d99e30e615e828e107b92349b77c4b5cffb4"} Sep 17 17:42:27.011105 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.010986 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" event={"ID":"e77eafce-5037-453d-b6b4-130343900637","Type":"ContainerStarted","Data":"51de68838288be84468ff58136a3abaa587745af1df58e80165b038e50b54b97"} Sep 17 17:42:27.011105 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.011070 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:27.018813 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.018779 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" Sep 17 17:42:27.050489 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.050407 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56bfbb9478-j9f57" podStartSLOduration=4.542320578 podStartE2EDuration="7.050379528s" totalImagesPullingTime="2.50805895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:27.050221329 +0000 UTC m=+76.894365371" watchObservedRunningTime="2026-09-17 17:42:27.050379528 +0000 UTC m=+76.894523558" Sep 17 17:42:27.079522 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.079446 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-sn442" podStartSLOduration=5.597961999 podStartE2EDuration="8.079419205s" totalImagesPullingTime="2.481457206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:27.07711209 +0000 UTC m=+76.921256124" watchObservedRunningTime="2026-09-17 17:42:27.079419205 +0000 UTC m=+76.923563236" Sep 17 17:42:27.108262 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.108061 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" podStartSLOduration=5.609348411 podStartE2EDuration="8.108026894s" totalImagesPullingTime="2.498678483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:27.107117986 +0000 UTC m=+76.951262016" watchObservedRunningTime="2026-09-17 17:42:27.108026894 +0000 UTC m=+76.952170926" Sep 17 17:42:27.167689 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.167651 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54bdfb7bb8-rxhm7"] Sep 17 17:42:27.205884 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.205795 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58ccd6559d-grgvx"] Sep 17 17:42:27.209056 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.208999 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.221032 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.220916 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58ccd6559d-grgvx"] Sep 17 17:42:27.345163 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.345122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-oauth-config\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.345376 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.345179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-service-ca\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.345376 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.345238 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdzl\" (UniqueName: \"kubernetes.io/projected/a831fe86-4c29-4f47-982b-83aa02104716-kube-api-access-2cdzl\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.345376 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.345328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-serving-cert\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.345376 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.345356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-oauth-serving-cert\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.345595 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.345426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-trusted-ca-bundle\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.345595 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.345478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-console-config\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.446607 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.446486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-oauth-config\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.446607 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.446565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-service-ca\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.446607 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.446593 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdzl\" (UniqueName: \"kubernetes.io/projected/a831fe86-4c29-4f47-982b-83aa02104716-kube-api-access-2cdzl\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.446904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.446662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-serving-cert\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.446904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.446693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-oauth-serving-cert\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.446904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.446764 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-trusted-ca-bundle\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.446904 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.446802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-console-config\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.447872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.447516 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-service-ca\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.447872 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.447526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-console-config\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.448350 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.447795 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-oauth-serving-cert\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.456187 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.449916 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-trusted-ca-bundle\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.457715 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.457682 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-oauth-config\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.457836 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.457736 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-serving-cert\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.462940 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.462902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdzl\" (UniqueName: \"kubernetes.io/projected/a831fe86-4c29-4f47-982b-83aa02104716-kube-api-access-2cdzl\") pod \"console-58ccd6559d-grgvx\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:27.524036 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:27.523975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:28.847946 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:28.847888 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58ccd6559d-grgvx"] Sep 17 17:42:28.855309 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:42:28.853908 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda831fe86_4c29_4f47_982b_83aa02104716.slice/crio-1573007042faa667a1ddb72cc0f272c7ba66a9186a0e10aedaf4220f8e3b88cc WatchSource:0}: Error finding container 1573007042faa667a1ddb72cc0f272c7ba66a9186a0e10aedaf4220f8e3b88cc: Status 404 returned error can't find the container with id 1573007042faa667a1ddb72cc0f272c7ba66a9186a0e10aedaf4220f8e3b88cc Sep 17 17:42:29.026789 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.026750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerStarted","Data":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} Sep 17 17:42:29.026979 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.026851 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerStarted","Data":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} Sep 17 17:42:29.026979 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.026895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerStarted","Data":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} Sep 17 17:42:29.026979 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.026933 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerStarted","Data":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} Sep 17 17:42:29.026979 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.026973 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerStarted","Data":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} Sep 17 17:42:29.029304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.029225 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ccd6559d-grgvx" event={"ID":"a831fe86-4c29-4f47-982b-83aa02104716","Type":"ContainerStarted","Data":"68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5"} Sep 17 17:42:29.029304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.029275 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ccd6559d-grgvx" event={"ID":"a831fe86-4c29-4f47-982b-83aa02104716","Type":"ContainerStarted","Data":"1573007042faa667a1ddb72cc0f272c7ba66a9186a0e10aedaf4220f8e3b88cc"} Sep 17 17:42:29.065614 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:29.065548 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58ccd6559d-grgvx" podStartSLOduration=2.065523636 podStartE2EDuration="2.065523636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:29.0634904 +0000 UTC m=+78.907634430" watchObservedRunningTime="2026-09-17 17:42:29.065523636 +0000 UTC m=+78.909667666" Sep 17 17:42:30.043370 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:30.043320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerStarted","Data":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} Sep 17 17:42:30.076914 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:30.076835 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.420100979 podStartE2EDuration="9.076809623s" totalImagesPullingTime="3.627931167s" totalInitContainerRuntime="28.777477ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:30.074537202 +0000 UTC m=+79.918681232" watchObservedRunningTime="2026-09-17 17:42:30.076809623 +0000 UTC m=+79.920953653" Sep 17 17:42:30.310671 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:30.310558 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:32.020188 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:32.020158 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f54c5d9fb-mbbzf" Sep 17 17:42:32.036901 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:32.036853 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:42:37.525142 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:37.525098 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:37.525723 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:37.525177 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:37.530475 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:37.530445 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:38.095034 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:38.094982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:42:38.148931 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:38.148889 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847d48d9d6-ndjls"] Sep 17 17:42:40.269956 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:40.269906 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:40.270423 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:40.270039 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:42:44.968257 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:44.968168 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7887d7cb87-ssbbr" podUID="03404759-ad40-4746-9ea4-936335e89090" containerName="console" containerID="cri-o://45f0b6995e0e50717b80de977bd5c0405fc43e57f154cfbd0f919139a76116ea" gracePeriod=15 Sep 17 17:42:45.132531 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.132492 2575 generic.go:356] "Generic (PLEG): container finished" podID="03404759-ad40-4746-9ea4-936335e89090" containerID="45f0b6995e0e50717b80de977bd5c0405fc43e57f154cfbd0f919139a76116ea" exitCode=0 Sep 17 17:42:45.132714 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.132562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7887d7cb87-ssbbr" event={"ID":"03404759-ad40-4746-9ea4-936335e89090","Type":"ContainerDied","Data":"45f0b6995e0e50717b80de977bd5c0405fc43e57f154cfbd0f919139a76116ea"} Sep 17 17:42:45.227722 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.227683 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:45.328125 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328081 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-serving-cert\") pod \"03404759-ad40-4746-9ea4-936335e89090\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " Sep 17 17:42:45.328325 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328161 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-console-config\") pod \"03404759-ad40-4746-9ea4-936335e89090\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " Sep 17 17:42:45.328325 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328259 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4qb9\" (UniqueName: \"kubernetes.io/projected/03404759-ad40-4746-9ea4-936335e89090-kube-api-access-x4qb9\") pod \"03404759-ad40-4746-9ea4-936335e89090\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " Sep 17 17:42:45.328325 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328285 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-oauth-serving-cert\") pod \"03404759-ad40-4746-9ea4-936335e89090\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " Sep 17 17:42:45.328325 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328324 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-trusted-ca-bundle\") pod \"03404759-ad40-4746-9ea4-936335e89090\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " Sep 17 17:42:45.328530 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328351 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-oauth-config\") pod \"03404759-ad40-4746-9ea4-936335e89090\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " Sep 17 17:42:45.328530 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328372 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-service-ca\") pod \"03404759-ad40-4746-9ea4-936335e89090\" (UID: \"03404759-ad40-4746-9ea4-936335e89090\") " Sep 17 17:42:45.328722 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328692 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-console-config" (OuterVolumeSpecName: "console-config") pod "03404759-ad40-4746-9ea4-936335e89090" (UID: "03404759-ad40-4746-9ea4-936335e89090"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:45.328868 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328818 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03404759-ad40-4746-9ea4-936335e89090" (UID: "03404759-ad40-4746-9ea4-936335e89090"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:45.328939 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328907 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-service-ca" (OuterVolumeSpecName: "service-ca") pod "03404759-ad40-4746-9ea4-936335e89090" (UID: "03404759-ad40-4746-9ea4-936335e89090"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:45.328996 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.328933 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03404759-ad40-4746-9ea4-936335e89090" (UID: "03404759-ad40-4746-9ea4-936335e89090"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:45.330881 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.330852 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03404759-ad40-4746-9ea4-936335e89090" (UID: "03404759-ad40-4746-9ea4-936335e89090"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:42:45.330881 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.330867 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03404759-ad40-4746-9ea4-936335e89090-kube-api-access-x4qb9" (OuterVolumeSpecName: "kube-api-access-x4qb9") pod "03404759-ad40-4746-9ea4-936335e89090" (UID: "03404759-ad40-4746-9ea4-936335e89090"). InnerVolumeSpecName "kube-api-access-x4qb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:42:45.331092 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.330908 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03404759-ad40-4746-9ea4-936335e89090" (UID: "03404759-ad40-4746-9ea4-936335e89090"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:42:45.429495 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.429430 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qb9\" (UniqueName: \"kubernetes.io/projected/03404759-ad40-4746-9ea4-936335e89090-kube-api-access-x4qb9\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:45.429495 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.429486 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-oauth-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:45.429495 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.429497 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-trusted-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:45.429495 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.429505 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-oauth-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:45.429495 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.429516 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-service-ca\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:45.429819 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.429524 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03404759-ad40-4746-9ea4-936335e89090-console-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:45.429819 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:45.429532 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03404759-ad40-4746-9ea4-936335e89090-console-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:46.139225 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:46.139184 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7887d7cb87-ssbbr" event={"ID":"03404759-ad40-4746-9ea4-936335e89090","Type":"ContainerDied","Data":"98a7fa607f9d59dbb91adc2a405e51effdd2bbd156e289657cd236c8aa6abb90"} Sep 17 17:42:46.139225 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:46.139206 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7887d7cb87-ssbbr" Sep 17 17:42:46.139709 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:46.139257 2575 scope.go:117] "RemoveContainer" containerID="45f0b6995e0e50717b80de977bd5c0405fc43e57f154cfbd0f919139a76116ea" Sep 17 17:42:46.161237 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:46.161193 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7887d7cb87-ssbbr"] Sep 17 17:42:46.164599 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:46.164566 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7887d7cb87-ssbbr"] Sep 17 17:42:46.341708 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:46.341667 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03404759-ad40-4746-9ea4-936335e89090" path="/var/lib/kubelet/pods/03404759-ad40-4746-9ea4-936335e89090/volumes" Sep 17 17:42:52.191716 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.191664 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54bdfb7bb8-rxhm7" podUID="f2986cb0-1eaf-457a-bfcc-8d298b0322c4" containerName="console" containerID="cri-o://e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9" gracePeriod=15 Sep 17 17:42:52.449468 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.449385 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:52.491903 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.491864 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-serving-cert\") pod \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " Sep 17 17:42:52.492132 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.491925 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-oauth-config\") pod \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " Sep 17 17:42:52.492132 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.491963 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-trusted-ca-bundle\") pod \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " Sep 17 17:42:52.492132 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.491989 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-service-ca\") pod \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " Sep 17 17:42:52.492132 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.492075 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-config\") pod \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " Sep 17 17:42:52.492132 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.492119 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzsmp\" (UniqueName: \"kubernetes.io/projected/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-kube-api-access-bzsmp\") pod \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " Sep 17 17:42:52.492392 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.492182 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-oauth-serving-cert\") pod \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\" (UID: \"f2986cb0-1eaf-457a-bfcc-8d298b0322c4\") " Sep 17 17:42:52.492957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.492544 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-service-ca" (OuterVolumeSpecName: "service-ca") pod "f2986cb0-1eaf-457a-bfcc-8d298b0322c4" (UID: "f2986cb0-1eaf-457a-bfcc-8d298b0322c4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:52.492957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.492728 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f2986cb0-1eaf-457a-bfcc-8d298b0322c4" (UID: "f2986cb0-1eaf-457a-bfcc-8d298b0322c4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:52.492957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.492905 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f2986cb0-1eaf-457a-bfcc-8d298b0322c4" (UID: "f2986cb0-1eaf-457a-bfcc-8d298b0322c4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:52.493230 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.492958 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-config" (OuterVolumeSpecName: "console-config") pod "f2986cb0-1eaf-457a-bfcc-8d298b0322c4" (UID: "f2986cb0-1eaf-457a-bfcc-8d298b0322c4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:42:52.494475 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.494450 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f2986cb0-1eaf-457a-bfcc-8d298b0322c4" (UID: "f2986cb0-1eaf-457a-bfcc-8d298b0322c4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:42:52.494825 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.494800 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-kube-api-access-bzsmp" (OuterVolumeSpecName: "kube-api-access-bzsmp") pod "f2986cb0-1eaf-457a-bfcc-8d298b0322c4" (UID: "f2986cb0-1eaf-457a-bfcc-8d298b0322c4"). InnerVolumeSpecName "kube-api-access-bzsmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:42:52.494943 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.494824 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f2986cb0-1eaf-457a-bfcc-8d298b0322c4" (UID: "f2986cb0-1eaf-457a-bfcc-8d298b0322c4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:42:52.593457 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.593403 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:52.593457 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.593449 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-oauth-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:52.593457 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.593458 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-trusted-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:52.593457 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.593471 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-service-ca\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:52.593457 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.593480 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-console-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:52.593788 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.593489 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzsmp\" (UniqueName: \"kubernetes.io/projected/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-kube-api-access-bzsmp\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:52.593788 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:52.593500 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2986cb0-1eaf-457a-bfcc-8d298b0322c4-oauth-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:42:53.174737 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.174701 2575 generic.go:356] "Generic (PLEG): container finished" podID="f2986cb0-1eaf-457a-bfcc-8d298b0322c4" containerID="e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9" exitCode=0 Sep 17 17:42:53.174936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.174749 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bdfb7bb8-rxhm7" Sep 17 17:42:53.174936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.174783 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bdfb7bb8-rxhm7" event={"ID":"f2986cb0-1eaf-457a-bfcc-8d298b0322c4","Type":"ContainerDied","Data":"e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9"} Sep 17 17:42:53.174936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.174829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bdfb7bb8-rxhm7" event={"ID":"f2986cb0-1eaf-457a-bfcc-8d298b0322c4","Type":"ContainerDied","Data":"3846803a6043778dd4e17bc76bd62739d4958e670cf0918e974b183383d77c7b"} Sep 17 17:42:53.174936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.174851 2575 scope.go:117] "RemoveContainer" containerID="e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9" Sep 17 17:42:53.184510 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.184490 2575 scope.go:117] "RemoveContainer" containerID="e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9" Sep 17 17:42:53.184891 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:42:53.184867 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9\": container with ID starting with e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9 not found: ID does not exist" containerID="e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9" Sep 17 17:42:53.184971 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.184902 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9"} err="failed to get container status \"e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9\": rpc error: code = NotFound desc = could not find container \"e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9\": container with ID starting with e5e7a86625267124cc7764e9ce83b37552ed0a75e19e5db530eeee7c9fd327b9 not found: ID does not exist" Sep 17 17:42:53.196906 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.196865 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54bdfb7bb8-rxhm7"] Sep 17 17:42:53.200094 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:53.200058 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54bdfb7bb8-rxhm7"] Sep 17 17:42:54.341545 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:54.341506 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2986cb0-1eaf-457a-bfcc-8d298b0322c4" path="/var/lib/kubelet/pods/f2986cb0-1eaf-457a-bfcc-8d298b0322c4/volumes" Sep 17 17:42:56.003261 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:42:56.003224 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8q5wm" Sep 17 17:43:00.275942 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:00.275905 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:43:00.280088 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:00.280057 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56c8f5fbb4-l7kl4" Sep 17 17:43:03.169728 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.169678 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-847d48d9d6-ndjls" podUID="2f1f70fb-1cf8-4de8-9a36-aa9563cada15" containerName="console" containerID="cri-o://6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f" gracePeriod=15 Sep 17 17:43:03.450983 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.450883 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:43:03.507459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.507414 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-config\") pod \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " Sep 17 17:43:03.507459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.507458 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-serving-cert\") pod \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " Sep 17 17:43:03.507746 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.507487 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-oauth-config\") pod \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " Sep 17 17:43:03.507746 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.507509 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-service-ca\") pod \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " Sep 17 17:43:03.507746 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.507550 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-oauth-serving-cert\") pod \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " Sep 17 17:43:03.507746 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.507635 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhv69\" (UniqueName: \"kubernetes.io/projected/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-kube-api-access-mhv69\") pod \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\" (UID: \"2f1f70fb-1cf8-4de8-9a36-aa9563cada15\") " Sep 17 17:43:03.507996 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.507961 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-config" (OuterVolumeSpecName: "console-config") pod "2f1f70fb-1cf8-4de8-9a36-aa9563cada15" (UID: "2f1f70fb-1cf8-4de8-9a36-aa9563cada15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:03.508086 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.508058 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f1f70fb-1cf8-4de8-9a36-aa9563cada15" (UID: "2f1f70fb-1cf8-4de8-9a36-aa9563cada15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:03.508291 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.508262 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f1f70fb-1cf8-4de8-9a36-aa9563cada15" (UID: "2f1f70fb-1cf8-4de8-9a36-aa9563cada15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:03.509877 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.509844 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f1f70fb-1cf8-4de8-9a36-aa9563cada15" (UID: "2f1f70fb-1cf8-4de8-9a36-aa9563cada15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:03.510070 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.510047 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-kube-api-access-mhv69" (OuterVolumeSpecName: "kube-api-access-mhv69") pod "2f1f70fb-1cf8-4de8-9a36-aa9563cada15" (UID: "2f1f70fb-1cf8-4de8-9a36-aa9563cada15"). InnerVolumeSpecName "kube-api-access-mhv69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:43:03.510146 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.510063 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f1f70fb-1cf8-4de8-9a36-aa9563cada15" (UID: "2f1f70fb-1cf8-4de8-9a36-aa9563cada15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:03.608540 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.608489 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:03.608540 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.608530 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:03.608540 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.608545 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-console-oauth-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:03.608858 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.608558 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-service-ca\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:03.608858 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.608570 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-oauth-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:03.608858 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:03.608582 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhv69\" (UniqueName: \"kubernetes.io/projected/2f1f70fb-1cf8-4de8-9a36-aa9563cada15-kube-api-access-mhv69\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:04.229254 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.229212 2575 generic.go:356] "Generic (PLEG): container finished" podID="2f1f70fb-1cf8-4de8-9a36-aa9563cada15" containerID="6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f" exitCode=0 Sep 17 17:43:04.229765 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.229277 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d48d9d6-ndjls" Sep 17 17:43:04.229765 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.229302 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d48d9d6-ndjls" event={"ID":"2f1f70fb-1cf8-4de8-9a36-aa9563cada15","Type":"ContainerDied","Data":"6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f"} Sep 17 17:43:04.229765 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.229407 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d48d9d6-ndjls" event={"ID":"2f1f70fb-1cf8-4de8-9a36-aa9563cada15","Type":"ContainerDied","Data":"420b2a43b665731ec88b31a2f2bb3d4b705234c23176cede31c5e77bace3cacf"} Sep 17 17:43:04.229765 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.229444 2575 scope.go:117] "RemoveContainer" containerID="6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f" Sep 17 17:43:04.238522 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.238504 2575 scope.go:117] "RemoveContainer" containerID="6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f" Sep 17 17:43:04.238878 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:04.238857 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f\": container with ID starting with 6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f not found: ID does not exist" containerID="6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f" Sep 17 17:43:04.238942 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.238892 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f"} err="failed to get container status \"6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f\": rpc error: code = NotFound desc = could not find container \"6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f\": container with ID starting with 6f9662d9f11bcf5b4b6541c6bdb798919c260671e86eccf634d854524f2ee76f not found: ID does not exist" Sep 17 17:43:04.249812 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.249771 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847d48d9d6-ndjls"] Sep 17 17:43:04.256168 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.256137 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-847d48d9d6-ndjls"] Sep 17 17:43:04.340793 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:04.340754 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f1f70fb-1cf8-4de8-9a36-aa9563cada15" path="/var/lib/kubelet/pods/2f1f70fb-1cf8-4de8-9a36-aa9563cada15/volumes" Sep 17 17:43:22.037336 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:22.037275 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:22.058550 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:22.058515 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:22.347946 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:22.347850 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:35.421846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.421810 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69cb889547-sh9xl"] Sep 17 17:43:35.422304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422206 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03404759-ad40-4746-9ea4-936335e89090" containerName="console" Sep 17 17:43:35.422304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422223 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="03404759-ad40-4746-9ea4-936335e89090" containerName="console" Sep 17 17:43:35.422304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422244 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2986cb0-1eaf-457a-bfcc-8d298b0322c4" containerName="console" Sep 17 17:43:35.422304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422250 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2986cb0-1eaf-457a-bfcc-8d298b0322c4" containerName="console" Sep 17 17:43:35.422304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422262 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1f70fb-1cf8-4de8-9a36-aa9563cada15" containerName="console" Sep 17 17:43:35.422304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422268 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1f70fb-1cf8-4de8-9a36-aa9563cada15" containerName="console" Sep 17 17:43:35.422505 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422331 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="03404759-ad40-4746-9ea4-936335e89090" containerName="console" Sep 17 17:43:35.422505 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422340 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2986cb0-1eaf-457a-bfcc-8d298b0322c4" containerName="console" Sep 17 17:43:35.422505 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.422351 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f1f70fb-1cf8-4de8-9a36-aa9563cada15" containerName="console" Sep 17 17:43:35.425462 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.425438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.436508 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.436466 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cb889547-sh9xl"] Sep 17 17:43:35.491545 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.491472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-config\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.491545 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.491525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-oauth-serving-cert\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.491780 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.491578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-trusted-ca-bundle\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.491780 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.491614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhwx\" (UniqueName: \"kubernetes.io/projected/81a5e788-0444-48dc-a633-1d75ba6cd9aa-kube-api-access-lmhwx\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.491780 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.491668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-serving-cert\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.491780 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.491725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-service-ca\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.491780 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.491764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-oauth-config\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.592715 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.592668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-config\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.592715 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.592722 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-oauth-serving-cert\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.592966 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.592746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-trusted-ca-bundle\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.592966 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.592769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhwx\" (UniqueName: \"kubernetes.io/projected/81a5e788-0444-48dc-a633-1d75ba6cd9aa-kube-api-access-lmhwx\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.592966 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.592823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-serving-cert\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.592966 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.592870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-service-ca\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.592966 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.592910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-oauth-config\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.593591 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.593564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-oauth-serving-cert\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.593707 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.593676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-config\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.593759 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.593728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-service-ca\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.593800 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.593759 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-trusted-ca-bundle\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.595497 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.595466 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-oauth-config\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.595613 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.595576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-serving-cert\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.601638 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.601606 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhwx\" (UniqueName: \"kubernetes.io/projected/81a5e788-0444-48dc-a633-1d75ba6cd9aa-kube-api-access-lmhwx\") pod \"console-69cb889547-sh9xl\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.735977 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.735877 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:35.881140 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.881096 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:43:35.881524 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.881493 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="alertmanager" containerID="cri-o://4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa" gracePeriod=120 Sep 17 17:43:35.881608 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.881540 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-metric" containerID="cri-o://4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757" gracePeriod=120 Sep 17 17:43:35.881685 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.881600 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy" containerID="cri-o://852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483" gracePeriod=120 Sep 17 17:43:35.881685 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.881584 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="prom-label-proxy" containerID="cri-o://4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172" gracePeriod=120 Sep 17 17:43:35.881685 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.881655 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="config-reloader" containerID="cri-o://437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df" gracePeriod=120 Sep 17 17:43:35.881831 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:35.881603 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-web" containerID="cri-o://a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3" gracePeriod=120 Sep 17 17:43:36.033136 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.033103 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cb889547-sh9xl"] Sep 17 17:43:36.035204 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:43:36.035175 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a5e788_0444_48dc_a633_1d75ba6cd9aa.slice/crio-d7973d9f4e7da8d0922eabc6282724cc8ebdcfccc2b076a48f6b58809740ad76 WatchSource:0}: Error finding container d7973d9f4e7da8d0922eabc6282724cc8ebdcfccc2b076a48f6b58809740ad76: Status 404 returned error can't find the container with id d7973d9f4e7da8d0922eabc6282724cc8ebdcfccc2b076a48f6b58809740ad76 Sep 17 17:43:36.391893 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.391855 2575 generic.go:356] "Generic (PLEG): container finished" podID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerID="4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172" exitCode=0 Sep 17 17:43:36.391893 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.391882 2575 generic.go:356] "Generic (PLEG): container finished" podID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerID="852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483" exitCode=0 Sep 17 17:43:36.391893 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.391889 2575 generic.go:356] "Generic (PLEG): container finished" podID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerID="437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df" exitCode=0 Sep 17 17:43:36.391893 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.391895 2575 generic.go:356] "Generic (PLEG): container finished" podID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerID="4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa" exitCode=0 Sep 17 17:43:36.392287 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.391926 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172"} Sep 17 17:43:36.392287 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.391995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483"} Sep 17 17:43:36.392287 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.392044 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df"} Sep 17 17:43:36.392287 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.392073 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa"} Sep 17 17:43:36.393690 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.393657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb889547-sh9xl" event={"ID":"81a5e788-0444-48dc-a633-1d75ba6cd9aa","Type":"ContainerStarted","Data":"6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605"} Sep 17 17:43:36.393827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.393715 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb889547-sh9xl" event={"ID":"81a5e788-0444-48dc-a633-1d75ba6cd9aa","Type":"ContainerStarted","Data":"d7973d9f4e7da8d0922eabc6282724cc8ebdcfccc2b076a48f6b58809740ad76"} Sep 17 17:43:36.414729 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:36.414663 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69cb889547-sh9xl" podStartSLOduration=1.4146421519999999 podStartE2EDuration="1.414642152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:43:36.412397481 +0000 UTC m=+146.256541509" watchObservedRunningTime="2026-09-17 17:43:36.414642152 +0000 UTC m=+146.258786180" Sep 17 17:43:37.144244 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.144210 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.207398 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207293 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-tls-assets\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207398 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207360 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-out\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207398 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207389 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-web-config\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207427 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207450 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207513 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-trusted-ca-bundle\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207559 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207590 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-main-tls\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207622 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-volume\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.207695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207664 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-cluster-tls-config\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.208144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207703 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-metrics-client-ca\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.208144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207738 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-main-db\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.208144 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.207811 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrnpq\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-kube-api-access-xrnpq\") pod \"825c90db-dd92-44cc-bfa4-0cd6720304f9\" (UID: \"825c90db-dd92-44cc-bfa4-0cd6720304f9\") " Sep 17 17:43:37.209602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.209133 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:37.209602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.209507 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:37.209602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.209548 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:43:37.210997 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.210939 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:37.211518 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.211482 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-kube-api-access-xrnpq" (OuterVolumeSpecName: "kube-api-access-xrnpq") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "kube-api-access-xrnpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:43:37.211877 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.211840 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:37.212275 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.212245 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:43:37.212402 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.212380 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:37.212669 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.212646 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-out" (OuterVolumeSpecName: "config-out") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:43:37.212943 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.212921 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-volume" (OuterVolumeSpecName: "config-volume") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:37.213905 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.213872 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:37.217331 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.217295 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:37.225903 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.225863 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-web-config" (OuterVolumeSpecName: "web-config") pod "825c90db-dd92-44cc-bfa4-0cd6720304f9" (UID: "825c90db-dd92-44cc-bfa4-0cd6720304f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:37.309131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309074 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-metrics-client-ca\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309118 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-main-db\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309130 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrnpq\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-kube-api-access-xrnpq\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309140 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825c90db-dd92-44cc-bfa4-0cd6720304f9-tls-assets\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309148 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-out\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309156 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-web-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309165 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309175 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309184 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825c90db-dd92-44cc-bfa4-0cd6720304f9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309193 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309202 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-secret-alertmanager-main-tls\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309209 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-config-volume\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.309485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.309219 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825c90db-dd92-44cc-bfa4-0cd6720304f9-cluster-tls-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:37.402028 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.401978 2575 generic.go:356] "Generic (PLEG): container finished" podID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerID="4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757" exitCode=0 Sep 17 17:43:37.402028 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.402019 2575 generic.go:356] "Generic (PLEG): container finished" podID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerID="a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3" exitCode=0 Sep 17 17:43:37.402267 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.402043 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757"} Sep 17 17:43:37.402267 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.402078 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.402267 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.402115 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3"} Sep 17 17:43:37.402267 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.402146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825c90db-dd92-44cc-bfa4-0cd6720304f9","Type":"ContainerDied","Data":"73ad79fa7780b23965e1d5fea59e2266b06f833c1cc955f350ea5292c56213df"} Sep 17 17:43:37.402267 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.402178 2575 scope.go:117] "RemoveContainer" containerID="4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172" Sep 17 17:43:37.411332 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.411224 2575 scope.go:117] "RemoveContainer" containerID="4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757" Sep 17 17:43:37.419617 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.419596 2575 scope.go:117] "RemoveContainer" containerID="852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483" Sep 17 17:43:37.428344 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.428302 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:43:37.428996 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.428977 2575 scope.go:117] "RemoveContainer" containerID="a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3" Sep 17 17:43:37.432297 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.432269 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:43:37.438186 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.438165 2575 scope.go:117] "RemoveContainer" containerID="437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df" Sep 17 17:43:37.448547 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.448504 2575 scope.go:117] "RemoveContainer" containerID="4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa" Sep 17 17:43:37.458148 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.458114 2575 scope.go:117] "RemoveContainer" containerID="d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d" Sep 17 17:43:37.462099 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462069 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:43:37.462459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462444 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="init-config-reloader" Sep 17 17:43:37.462459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462459 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="init-config-reloader" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462469 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="config-reloader" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462476 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="config-reloader" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462484 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="prom-label-proxy" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462490 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="prom-label-proxy" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462498 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="alertmanager" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462503 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="alertmanager" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462517 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-web" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462522 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-web" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462529 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-metric" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462534 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-metric" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462547 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy" Sep 17 17:43:37.462585 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462552 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy" Sep 17 17:43:37.462987 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462604 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-metric" Sep 17 17:43:37.462987 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462612 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="prom-label-proxy" Sep 17 17:43:37.462987 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462618 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="config-reloader" Sep 17 17:43:37.462987 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462625 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy-web" Sep 17 17:43:37.462987 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462631 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="alertmanager" Sep 17 17:43:37.462987 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.462636 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" containerName="kube-rbac-proxy" Sep 17 17:43:37.466547 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.466519 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.468277 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468260 2575 scope.go:117] "RemoveContainer" containerID="4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172" Sep 17 17:43:37.468710 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:37.468686 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172\": container with ID starting with 4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172 not found: ID does not exist" containerID="4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172" Sep 17 17:43:37.468794 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468720 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172"} err="failed to get container status \"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172\": rpc error: code = NotFound desc = could not find container \"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172\": container with ID starting with 4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172 not found: ID does not exist" Sep 17 17:43:37.468794 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468749 2575 scope.go:117] "RemoveContainer" containerID="4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757" Sep 17 17:43:37.468957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468881 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:43:37.468957 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468931 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:43:37.469139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468878 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:43:37.469139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469001 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:43:37.469139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469001 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:43:37.469139 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:37.469101 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757\": container with ID starting with 4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757 not found: ID does not exist" containerID="4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757" Sep 17 17:43:37.469139 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468878 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:43:37.469434 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469132 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757"} err="failed to get container status \"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757\": rpc error: code = NotFound desc = could not find container \"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757\": container with ID starting with 4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757 not found: ID does not exist" Sep 17 17:43:37.469434 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469157 2575 scope.go:117] "RemoveContainer" containerID="852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483" Sep 17 17:43:37.469434 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.468931 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:43:37.469642 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:37.469475 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483\": container with ID starting with 852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483 not found: ID does not exist" containerID="852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483" Sep 17 17:43:37.469642 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469506 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483"} err="failed to get container status \"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483\": rpc error: code = NotFound desc = could not find container \"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483\": container with ID starting with 852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483 not found: ID does not exist" Sep 17 17:43:37.469642 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469532 2575 scope.go:117] "RemoveContainer" containerID="a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3" Sep 17 17:43:37.469811 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469710 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pnvns\"" Sep 17 17:43:37.469915 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.469897 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:43:37.470041 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:37.469974 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3\": container with ID starting with a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3 not found: ID does not exist" containerID="a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3" Sep 17 17:43:37.470161 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.470057 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3"} err="failed to get container status \"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3\": rpc error: code = NotFound desc = could not find container \"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3\": container with ID starting with a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3 not found: ID does not exist" Sep 17 17:43:37.470161 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.470082 2575 scope.go:117] "RemoveContainer" containerID="437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df" Sep 17 17:43:37.470531 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:37.470497 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df\": container with ID starting with 437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df not found: ID does not exist" containerID="437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df" Sep 17 17:43:37.470640 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.470535 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df"} err="failed to get container status \"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df\": rpc error: code = NotFound desc = could not find container \"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df\": container with ID starting with 437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df not found: ID does not exist" Sep 17 17:43:37.470640 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.470561 2575 scope.go:117] "RemoveContainer" containerID="4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa" Sep 17 17:43:37.472287 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:37.472085 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa\": container with ID starting with 4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa not found: ID does not exist" containerID="4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa" Sep 17 17:43:37.472287 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.472118 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa"} err="failed to get container status \"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa\": rpc error: code = NotFound desc = could not find container \"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa\": container with ID starting with 4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa not found: ID does not exist" Sep 17 17:43:37.472287 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.472140 2575 scope.go:117] "RemoveContainer" containerID="d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d" Sep 17 17:43:37.473692 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:37.473667 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d\": container with ID starting with d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d not found: ID does not exist" containerID="d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d" Sep 17 17:43:37.473794 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.473698 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d"} err="failed to get container status \"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d\": rpc error: code = NotFound desc = could not find container \"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d\": container with ID starting with d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d not found: ID does not exist" Sep 17 17:43:37.473794 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.473720 2575 scope.go:117] "RemoveContainer" containerID="4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172" Sep 17 17:43:37.474095 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474069 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172"} err="failed to get container status \"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172\": rpc error: code = NotFound desc = could not find container \"4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172\": container with ID starting with 4ae534418c69065bd461d6a55a04694c4fba72866a8844b4009ed3e6e3a6d172 not found: ID does not exist" Sep 17 17:43:37.474095 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474098 2575 scope.go:117] "RemoveContainer" containerID="4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757" Sep 17 17:43:37.474396 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474365 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757"} err="failed to get container status \"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757\": rpc error: code = NotFound desc = could not find container \"4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757\": container with ID starting with 4d5a8908d429b3a2416a8a6d92c1f81179e6d7a871a25a2122e577e533129757 not found: ID does not exist" Sep 17 17:43:37.474458 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474396 2575 scope.go:117] "RemoveContainer" containerID="852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483" Sep 17 17:43:37.474501 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474479 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:43:37.474704 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474679 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483"} err="failed to get container status \"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483\": rpc error: code = NotFound desc = could not find container \"852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483\": container with ID starting with 852b04f171b5f5e7f21730f02f2f07fc10ea7af11172443ee184285637191483 not found: ID does not exist" Sep 17 17:43:37.474787 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474704 2575 scope.go:117] "RemoveContainer" containerID="a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3" Sep 17 17:43:37.474992 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474975 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3"} err="failed to get container status \"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3\": rpc error: code = NotFound desc = could not find container \"a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3\": container with ID starting with a11b74adc8f283c846b5f1521e0b1276f739b32d409128f58603e9ed25b5eeb3 not found: ID does not exist" Sep 17 17:43:37.475092 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.474993 2575 scope.go:117] "RemoveContainer" containerID="437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df" Sep 17 17:43:37.475311 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.475290 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df"} err="failed to get container status \"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df\": rpc error: code = NotFound desc = could not find container \"437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df\": container with ID starting with 437fadfab4fc46e287ac1b342c33525204db8dcc1c02e8b4f3017d7effc9b2df not found: ID does not exist" Sep 17 17:43:37.475349 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.475313 2575 scope.go:117] "RemoveContainer" containerID="4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa" Sep 17 17:43:37.475613 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.475592 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa"} err="failed to get container status \"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa\": rpc error: code = NotFound desc = could not find container \"4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa\": container with ID starting with 4738db24a6fd68d972d08d8c72ffcd31a5235fc9d2c80983a499b7d8cacecbaa not found: ID does not exist" Sep 17 17:43:37.475690 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.475613 2575 scope.go:117] "RemoveContainer" containerID="d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d" Sep 17 17:43:37.475952 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.475901 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d"} err="failed to get container status \"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d\": rpc error: code = NotFound desc = could not find container \"d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d\": container with ID starting with d505dda850dc9686a733432a31dd7dd483119c7a1df9f3412d98012e1c6e619d not found: ID does not exist" Sep 17 17:43:37.483724 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.483686 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:43:37.511377 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-web-config\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511377 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xx5d\" (UniqueName: \"kubernetes.io/projected/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-kube-api-access-5xx5d\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511774 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511774 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-config-out\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511774 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511774 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511774 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511774 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511970 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511970 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511970 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.511970 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.512125 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.511973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.612975 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.612937 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.612975 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.612986 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613234 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613027 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613234 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613234 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613234 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613425 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613425 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613425 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613425 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-web-config\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613425 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xx5d\" (UniqueName: \"kubernetes.io/projected/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-kube-api-access-5xx5d\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613659 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613659 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-config-out\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.613907 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.613840 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.614540 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.614515 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.614815 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.614790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.616740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.616684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-web-config\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.616870 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.616784 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.616870 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.616830 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.616870 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.616845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.617067 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.616902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.617174 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.617151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-config-out\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.617305 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.617288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.617553 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.617534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.618235 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.618216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.623513 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.623478 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xx5d\" (UniqueName: \"kubernetes.io/projected/a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5-kube-api-access-5xx5d\") pod \"alertmanager-main-0\" (UID: \"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:37.779293 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:37.779253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:43:38.063418 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:38.063250 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:43:38.065979 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:43:38.065938 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ab926b_da6e_46fb_bdaa_3fdb7cb7e0a5.slice/crio-d901597829e29f0fed8a92e64fc667cd221385a4a335d73cdb73c80fdce3dfef WatchSource:0}: Error finding container d901597829e29f0fed8a92e64fc667cd221385a4a335d73cdb73c80fdce3dfef: Status 404 returned error can't find the container with id d901597829e29f0fed8a92e64fc667cd221385a4a335d73cdb73c80fdce3dfef Sep 17 17:43:38.341452 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:38.341353 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="825c90db-dd92-44cc-bfa4-0cd6720304f9" path="/var/lib/kubelet/pods/825c90db-dd92-44cc-bfa4-0cd6720304f9/volumes" Sep 17 17:43:38.409160 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:38.409115 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5" containerID="9da72eb2f49a783392f66ecc0926fe2edfc42e57185741c9ada9face172b7a97" exitCode=0 Sep 17 17:43:38.409346 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:38.409204 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerDied","Data":"9da72eb2f49a783392f66ecc0926fe2edfc42e57185741c9ada9face172b7a97"} Sep 17 17:43:38.409346 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:38.409268 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerStarted","Data":"d901597829e29f0fed8a92e64fc667cd221385a4a335d73cdb73c80fdce3dfef"} Sep 17 17:43:39.418241 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:39.418197 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerStarted","Data":"007c2bc56be7b3c423923b1e1dfb95f711fb8b38291e90b2c086f8a9ed0c7ab9"} Sep 17 17:43:39.418740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:39.418304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerStarted","Data":"4cd23bb6c2738c4b97520b29d390fa62a5c86aade9cd03377b61dac0652bee93"} Sep 17 17:43:39.418740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:39.418334 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerStarted","Data":"2930a42d103b41c0f25565fb7771347d5069ee91261334881636e6763a11f2fa"} Sep 17 17:43:39.418740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:39.418364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerStarted","Data":"af4a5e69944be8ddc06da09b96c047ae3619f899ae9725c56a227b2a6db4ee1c"} Sep 17 17:43:39.418740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:39.418430 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerStarted","Data":"116cbd7731a7e106d824c30e3dcea0c07c12c604e593acb63ac2c981f2b38844"} Sep 17 17:43:39.418740 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:39.418465 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5","Type":"ContainerStarted","Data":"a468c16d882d2a9182d53085d95b39af6ea8b5cbded0ee29dd9d98f984397807"} Sep 17 17:43:39.446692 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:39.446615 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.429027513 podStartE2EDuration="2.446589553s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.56204ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:43:39.445791189 +0000 UTC m=+149.289935236" watchObservedRunningTime="2026-09-17 17:43:39.446589553 +0000 UTC m=+149.290733583" Sep 17 17:43:40.146102 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.146055 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:43:40.146541 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.146498 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="prometheus" containerID="cri-o://2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" gracePeriod=600 Sep 17 17:43:40.146801 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.146523 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-web" containerID="cri-o://8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" gracePeriod=600 Sep 17 17:43:40.146926 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.146547 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy" containerID="cri-o://b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" gracePeriod=600 Sep 17 17:43:40.146987 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.146559 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="config-reloader" containerID="cri-o://1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" gracePeriod=600 Sep 17 17:43:40.147080 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.146579 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="thanos-sidecar" containerID="cri-o://45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" gracePeriod=600 Sep 17 17:43:40.147137 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.146656 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-thanos" containerID="cri-o://92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" gracePeriod=600 Sep 17 17:43:40.420914 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.420873 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.426936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.426898 2575 generic.go:356] "Generic (PLEG): container finished" podID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" exitCode=0 Sep 17 17:43:40.426936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.426931 2575 generic.go:356] "Generic (PLEG): container finished" podID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" exitCode=0 Sep 17 17:43:40.426936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.426942 2575 generic.go:356] "Generic (PLEG): container finished" podID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" exitCode=0 Sep 17 17:43:40.426936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.426950 2575 generic.go:356] "Generic (PLEG): container finished" podID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" exitCode=0 Sep 17 17:43:40.426936 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.426959 2575 generic.go:356] "Generic (PLEG): container finished" podID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" exitCode=0 Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.426968 2575 generic.go:356] "Generic (PLEG): container finished" podID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" exitCode=0 Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.426984 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427031 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427110 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427192 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427202 2575 scope.go:117] "RemoveContainer" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427270 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} Sep 17 17:43:40.427420 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.427312 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91c9b98-ec3a-42ea-8240-8ed1d16667ca","Type":"ContainerDied","Data":"f063c20869f9a1ccb1ef5bcd921df0759b1d2fd1ffd772e00f9312980fe1ef92"} Sep 17 17:43:40.436838 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.436806 2575 scope.go:117] "RemoveContainer" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.446866 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.446829 2575 scope.go:117] "RemoveContainer" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.458819 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.458790 2575 scope.go:117] "RemoveContainer" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.470149 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.470121 2575 scope.go:117] "RemoveContainer" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.480815 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.480787 2575 scope.go:117] "RemoveContainer" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.493920 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.493893 2575 scope.go:117] "RemoveContainer" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.503913 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.503888 2575 scope.go:117] "RemoveContainer" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.504384 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:40.504360 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": container with ID starting with 92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4 not found: ID does not exist" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.504494 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.504392 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} err="failed to get container status \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": rpc error: code = NotFound desc = could not find container \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": container with ID starting with 92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4 not found: ID does not exist" Sep 17 17:43:40.504494 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.504420 2575 scope.go:117] "RemoveContainer" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.504814 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:40.504794 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": container with ID starting with b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af not found: ID does not exist" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.504886 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.504817 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} err="failed to get container status \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": rpc error: code = NotFound desc = could not find container \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": container with ID starting with b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af not found: ID does not exist" Sep 17 17:43:40.504886 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.504833 2575 scope.go:117] "RemoveContainer" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.505168 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:40.505146 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": container with ID starting with 8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57 not found: ID does not exist" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.505264 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.505173 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} err="failed to get container status \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": rpc error: code = NotFound desc = could not find container \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": container with ID starting with 8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57 not found: ID does not exist" Sep 17 17:43:40.505264 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.505191 2575 scope.go:117] "RemoveContainer" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.505478 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:40.505456 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": container with ID starting with 45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca not found: ID does not exist" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.505557 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.505481 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} err="failed to get container status \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": rpc error: code = NotFound desc = could not find container \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": container with ID starting with 45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca not found: ID does not exist" Sep 17 17:43:40.505557 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.505495 2575 scope.go:117] "RemoveContainer" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.505849 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:40.505816 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": container with ID starting with 1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56 not found: ID does not exist" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.505849 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.505841 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} err="failed to get container status \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": rpc error: code = NotFound desc = could not find container \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": container with ID starting with 1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56 not found: ID does not exist" Sep 17 17:43:40.505988 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.505857 2575 scope.go:117] "RemoveContainer" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.506172 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:40.506152 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": container with ID starting with 2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8 not found: ID does not exist" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.506232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.506176 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} err="failed to get container status \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": rpc error: code = NotFound desc = could not find container \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": container with ID starting with 2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8 not found: ID does not exist" Sep 17 17:43:40.506232 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.506196 2575 scope.go:117] "RemoveContainer" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.506542 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:43:40.506515 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": container with ID starting with 98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0 not found: ID does not exist" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.506614 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.506547 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0"} err="failed to get container status \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": rpc error: code = NotFound desc = could not find container \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": container with ID starting with 98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0 not found: ID does not exist" Sep 17 17:43:40.506614 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.506569 2575 scope.go:117] "RemoveContainer" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.507348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.506847 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} err="failed to get container status \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": rpc error: code = NotFound desc = could not find container \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": container with ID starting with 92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4 not found: ID does not exist" Sep 17 17:43:40.507348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.506865 2575 scope.go:117] "RemoveContainer" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.507348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.507128 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} err="failed to get container status \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": rpc error: code = NotFound desc = could not find container \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": container with ID starting with b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af not found: ID does not exist" Sep 17 17:43:40.507348 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.507148 2575 scope.go:117] "RemoveContainer" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.507530 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.507419 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} err="failed to get container status \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": rpc error: code = NotFound desc = could not find container \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": container with ID starting with 8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57 not found: ID does not exist" Sep 17 17:43:40.507530 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.507439 2575 scope.go:117] "RemoveContainer" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.507722 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.507704 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} err="failed to get container status \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": rpc error: code = NotFound desc = could not find container \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": container with ID starting with 45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca not found: ID does not exist" Sep 17 17:43:40.507772 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.507723 2575 scope.go:117] "RemoveContainer" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.507999 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.507974 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} err="failed to get container status \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": rpc error: code = NotFound desc = could not find container \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": container with ID starting with 1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56 not found: ID does not exist" Sep 17 17:43:40.508092 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.508001 2575 scope.go:117] "RemoveContainer" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.508354 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.508326 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} err="failed to get container status \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": rpc error: code = NotFound desc = could not find container \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": container with ID starting with 2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8 not found: ID does not exist" Sep 17 17:43:40.508476 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.508354 2575 scope.go:117] "RemoveContainer" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.508791 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.508643 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0"} err="failed to get container status \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": rpc error: code = NotFound desc = could not find container \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": container with ID starting with 98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0 not found: ID does not exist" Sep 17 17:43:40.508791 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.508664 2575 scope.go:117] "RemoveContainer" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.509053 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.508973 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} err="failed to get container status \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": rpc error: code = NotFound desc = could not find container \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": container with ID starting with 92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4 not found: ID does not exist" Sep 17 17:43:40.509053 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.508998 2575 scope.go:117] "RemoveContainer" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.511168 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.511139 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} err="failed to get container status \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": rpc error: code = NotFound desc = could not find container \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": container with ID starting with b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af not found: ID does not exist" Sep 17 17:43:40.511168 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.511167 2575 scope.go:117] "RemoveContainer" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.511525 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.511501 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} err="failed to get container status \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": rpc error: code = NotFound desc = could not find container \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": container with ID starting with 8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57 not found: ID does not exist" Sep 17 17:43:40.511648 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.511526 2575 scope.go:117] "RemoveContainer" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.511877 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.511846 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} err="failed to get container status \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": rpc error: code = NotFound desc = could not find container \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": container with ID starting with 45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca not found: ID does not exist" Sep 17 17:43:40.511959 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.511879 2575 scope.go:117] "RemoveContainer" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.512201 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.512179 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} err="failed to get container status \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": rpc error: code = NotFound desc = could not find container \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": container with ID starting with 1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56 not found: ID does not exist" Sep 17 17:43:40.512271 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.512204 2575 scope.go:117] "RemoveContainer" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.512471 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.512451 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} err="failed to get container status \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": rpc error: code = NotFound desc = could not find container \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": container with ID starting with 2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8 not found: ID does not exist" Sep 17 17:43:40.512531 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.512472 2575 scope.go:117] "RemoveContainer" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.512788 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.512766 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0"} err="failed to get container status \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": rpc error: code = NotFound desc = could not find container \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": container with ID starting with 98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0 not found: ID does not exist" Sep 17 17:43:40.512842 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.512790 2575 scope.go:117] "RemoveContainer" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.513146 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513125 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} err="failed to get container status \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": rpc error: code = NotFound desc = could not find container \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": container with ID starting with 92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4 not found: ID does not exist" Sep 17 17:43:40.513229 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513147 2575 scope.go:117] "RemoveContainer" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.513423 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513407 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} err="failed to get container status \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": rpc error: code = NotFound desc = could not find container \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": container with ID starting with b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af not found: ID does not exist" Sep 17 17:43:40.513486 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513426 2575 scope.go:117] "RemoveContainer" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.513726 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513698 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} err="failed to get container status \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": rpc error: code = NotFound desc = could not find container \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": container with ID starting with 8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57 not found: ID does not exist" Sep 17 17:43:40.513726 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513719 2575 scope.go:117] "RemoveContainer" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.513989 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513971 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} err="failed to get container status \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": rpc error: code = NotFound desc = could not find container \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": container with ID starting with 45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca not found: ID does not exist" Sep 17 17:43:40.514073 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.513990 2575 scope.go:117] "RemoveContainer" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.514327 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.514301 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} err="failed to get container status \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": rpc error: code = NotFound desc = could not find container \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": container with ID starting with 1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56 not found: ID does not exist" Sep 17 17:43:40.514417 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.514329 2575 scope.go:117] "RemoveContainer" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.514658 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.514618 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} err="failed to get container status \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": rpc error: code = NotFound desc = could not find container \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": container with ID starting with 2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8 not found: ID does not exist" Sep 17 17:43:40.514658 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.514653 2575 scope.go:117] "RemoveContainer" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.516476 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.516102 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0"} err="failed to get container status \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": rpc error: code = NotFound desc = could not find container \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": container with ID starting with 98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0 not found: ID does not exist" Sep 17 17:43:40.516476 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.516127 2575 scope.go:117] "RemoveContainer" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.516476 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.516390 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} err="failed to get container status \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": rpc error: code = NotFound desc = could not find container \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": container with ID starting with 92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4 not found: ID does not exist" Sep 17 17:43:40.516476 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.516409 2575 scope.go:117] "RemoveContainer" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.517153 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.516687 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} err="failed to get container status \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": rpc error: code = NotFound desc = could not find container \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": container with ID starting with b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af not found: ID does not exist" Sep 17 17:43:40.517153 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.516709 2575 scope.go:117] "RemoveContainer" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.517153 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.516992 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} err="failed to get container status \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": rpc error: code = NotFound desc = could not find container \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": container with ID starting with 8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57 not found: ID does not exist" Sep 17 17:43:40.517153 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.517034 2575 scope.go:117] "RemoveContainer" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.517803 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.517305 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} err="failed to get container status \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": rpc error: code = NotFound desc = could not find container \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": container with ID starting with 45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca not found: ID does not exist" Sep 17 17:43:40.517803 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.517324 2575 scope.go:117] "RemoveContainer" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.517803 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.517568 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} err="failed to get container status \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": rpc error: code = NotFound desc = could not find container \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": container with ID starting with 1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56 not found: ID does not exist" Sep 17 17:43:40.517803 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.517599 2575 scope.go:117] "RemoveContainer" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.518035 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.517843 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} err="failed to get container status \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": rpc error: code = NotFound desc = could not find container \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": container with ID starting with 2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8 not found: ID does not exist" Sep 17 17:43:40.518035 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.517866 2575 scope.go:117] "RemoveContainer" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.518193 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.518173 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0"} err="failed to get container status \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": rpc error: code = NotFound desc = could not find container \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": container with ID starting with 98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0 not found: ID does not exist" Sep 17 17:43:40.518252 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.518193 2575 scope.go:117] "RemoveContainer" containerID="92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4" Sep 17 17:43:40.518490 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.518463 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4"} err="failed to get container status \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": rpc error: code = NotFound desc = could not find container \"92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4\": container with ID starting with 92acb3b04db6392ead19e84bdd0fd84a4595dc09ebca42096511ec630e723cd4 not found: ID does not exist" Sep 17 17:43:40.518490 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.518488 2575 scope.go:117] "RemoveContainer" containerID="b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af" Sep 17 17:43:40.518797 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.518776 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af"} err="failed to get container status \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": rpc error: code = NotFound desc = could not find container \"b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af\": container with ID starting with b13a8e4571834247d08514287707d72fab5fc12c7817a87261440ad1062616af not found: ID does not exist" Sep 17 17:43:40.518852 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.518800 2575 scope.go:117] "RemoveContainer" containerID="8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57" Sep 17 17:43:40.519118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519096 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57"} err="failed to get container status \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": rpc error: code = NotFound desc = could not find container \"8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57\": container with ID starting with 8276f5c1d672511b1e80b01b1ecf952ee688a58088c614404f8db221bf242d57 not found: ID does not exist" Sep 17 17:43:40.519118 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519117 2575 scope.go:117] "RemoveContainer" containerID="45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca" Sep 17 17:43:40.519395 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519373 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca"} err="failed to get container status \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": rpc error: code = NotFound desc = could not find container \"45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca\": container with ID starting with 45faa01eae49cf12f983e0c8c8977fc3d91d800af9a0ef646f0e0f702f1744ca not found: ID does not exist" Sep 17 17:43:40.519395 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519394 2575 scope.go:117] "RemoveContainer" containerID="1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56" Sep 17 17:43:40.519681 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519659 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56"} err="failed to get container status \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": rpc error: code = NotFound desc = could not find container \"1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56\": container with ID starting with 1dc290b2ddb73e6f44e682012d51760dbf34efbee9ddeeb9d9ad70715be76d56 not found: ID does not exist" Sep 17 17:43:40.519752 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519682 2575 scope.go:117] "RemoveContainer" containerID="2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8" Sep 17 17:43:40.519962 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519939 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8"} err="failed to get container status \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": rpc error: code = NotFound desc = could not find container \"2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8\": container with ID starting with 2baa846fda5816860f14b47e7d63d9ba7f6b99b1212b340a15012cf9880a27e8 not found: ID does not exist" Sep 17 17:43:40.520054 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.519964 2575 scope.go:117] "RemoveContainer" containerID="98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0" Sep 17 17:43:40.520252 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.520232 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0"} err="failed to get container status \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": rpc error: code = NotFound desc = could not find container \"98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0\": container with ID starting with 98f2894ba419d0b0d0d9874b2a8533dd811144e3f75f634c84699c48c83060a0 not found: ID does not exist" Sep 17 17:43:40.544660 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544616 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-0\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544673 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-db\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544691 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544719 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-kubelet-serving-ca-bundle\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544745 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-tls\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544768 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-trusted-ca-bundle\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544811 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-thanos-prometheus-http-client-file\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544839 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c427q\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-kube-api-access-c427q\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.544880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.544871 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545065 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config-out\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545095 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-web-config\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545133 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-2\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545158 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-grpc-tls\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545192 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-kube-rbac-proxy\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545226 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545280 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545256 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-serving-certs-ca-bundle\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545360 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-metrics-client-certs\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545383 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-1\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545406 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-metrics-client-ca\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.545602 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.545431 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-tls-assets\") pod \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\" (UID: \"d91c9b98-ec3a-42ea-8240-8ed1d16667ca\") " Sep 17 17:43:40.547400 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.546554 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:40.547400 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.547202 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:40.547400 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.547261 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:40.548482 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.547491 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:43:40.548871 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.548740 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:40.549157 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.549131 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:40.549634 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.549595 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:40.550302 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.550116 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-kube-api-access-c427q" (OuterVolumeSpecName: "kube-api-access-c427q") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "kube-api-access-c427q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:43:40.550412 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.550331 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:40.550690 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.550470 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.551797 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.551704 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config" (OuterVolumeSpecName: "config") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.551906 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.551829 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.551906 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.551861 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config-out" (OuterVolumeSpecName: "config-out") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:43:40.553777 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.551972 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.556673 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.554331 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:43:40.556949 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.556916 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.557537 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.557500 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.557681 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.557605 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.557724 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.557683 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.558969 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.558933 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.568800 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.568758 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-web-config" (OuterVolumeSpecName: "web-config") pod "d91c9b98-ec3a-42ea-8240-8ed1d16667ca" (UID: "d91c9b98-ec3a-42ea-8240-8ed1d16667ca"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:40.652597 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652540 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-db\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652597 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652589 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652597 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652605 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652597 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652616 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652627 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652636 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c427q\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-kube-api-access-c427q\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652646 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652655 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-config-out\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652663 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-web-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652671 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652679 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-grpc-tls\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652688 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-kube-rbac-proxy\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652696 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652705 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652715 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-secret-metrics-client-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652723 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652732 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-configmap-metrics-client-ca\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652740 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-tls-assets\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.652876 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.652748 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91c9b98-ec3a-42ea-8240-8ed1d16667ca-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:43:40.762680 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.762645 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:43:40.771437 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.771396 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:43:40.827980 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.827938 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:43:40.828481 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828462 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="config-reloader" Sep 17 17:43:40.828481 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828483 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="config-reloader" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828493 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-thanos" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828499 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-thanos" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828510 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="prometheus" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828516 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="prometheus" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828525 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828530 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828538 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="init-config-reloader" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828544 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="init-config-reloader" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828553 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="thanos-sidecar" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828558 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="thanos-sidecar" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828568 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-web" Sep 17 17:43:40.828583 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828572 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-web" Sep 17 17:43:40.828908 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828625 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy" Sep 17 17:43:40.828908 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828633 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="config-reloader" Sep 17 17:43:40.828908 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828639 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="thanos-sidecar" Sep 17 17:43:40.828908 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828646 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="prometheus" Sep 17 17:43:40.828908 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828653 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-web" Sep 17 17:43:40.828908 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.828659 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" containerName="kube-rbac-proxy-thanos" Sep 17 17:43:40.832945 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.832920 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.836847 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.836822 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 17:43:40.836993 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.836819 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 17:43:40.836993 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.836949 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ns9sl8ais05s\"" Sep 17 17:43:40.837311 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.837295 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 17:43:40.837421 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.837344 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 17:43:40.837554 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.837539 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 17:43:40.837826 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.837809 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 17:43:40.837902 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.837853 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 17:43:40.837902 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.837831 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 17:43:40.838046 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.838032 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 17:43:40.838316 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.838303 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 17:43:40.838934 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.838917 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 17:43:40.839366 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.839349 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 17:43:40.840411 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.840388 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxkbd\"" Sep 17 17:43:40.843692 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.843608 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 17:43:40.845273 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.845246 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 17:43:40.854880 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.854754 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:43:40.955959 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.955912 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.955959 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.955967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956244 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.955990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956244 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956244 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956244 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956244 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956244 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg2s2\" (UniqueName: \"kubernetes.io/projected/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-kube-api-access-hg2s2\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956459 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956637 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-config-out\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956637 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956637 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-web-config\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956637 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956577 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956637 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-config\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:40.956637 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:40.956610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.057531 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.057531 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-web-config\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.057827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057616 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.057827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-config\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.057827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.057827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057799 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058054 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058054 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058054 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058054 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.057955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058054 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058130 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg2s2\" (UniqueName: \"kubernetes.io/projected/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-kube-api-access-hg2s2\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058313 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058663 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.058663 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-config-out\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.060976 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.058970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.060976 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.059939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.060976 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.060799 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.060976 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.060892 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.061303 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.061047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.061303 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.061118 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-config-out\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.061303 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.061196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.061303 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.061256 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-config\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.061303 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.061273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-web-config\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.061548 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.061500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.061735 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.061687 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.062060 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.062035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.062231 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.062207 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.062705 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.062679 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.063666 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.063639 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.063735 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.063705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.063786 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.063770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.063983 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.063961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.064416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.064394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.068932 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.068898 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg2s2\" (UniqueName: \"kubernetes.io/projected/a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657-kube-api-access-hg2s2\") pod \"prometheus-k8s-0\" (UID: \"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.144167 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.144125 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:41.436131 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:41.436036 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:43:41.439059 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:43:41.439022 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ae8ea5_9a73_4cae_8ccb_eeb0bd5d6657.slice/crio-d6afb112026788aa81d6a3fb73831b849dc808ab8e65f3ca7b0b27e5e5b87f77 WatchSource:0}: Error finding container d6afb112026788aa81d6a3fb73831b849dc808ab8e65f3ca7b0b27e5e5b87f77: Status 404 returned error can't find the container with id d6afb112026788aa81d6a3fb73831b849dc808ab8e65f3ca7b0b27e5e5b87f77 Sep 17 17:43:42.341272 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:42.341235 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d91c9b98-ec3a-42ea-8240-8ed1d16667ca" path="/var/lib/kubelet/pods/d91c9b98-ec3a-42ea-8240-8ed1d16667ca/volumes" Sep 17 17:43:42.439865 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:42.439769 2575 generic.go:356] "Generic (PLEG): container finished" podID="a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657" containerID="d80d8fdd18dd5ecc135bccd146413a8d9a051f5b2a1773dec577782bf0b60746" exitCode=0 Sep 17 17:43:42.439865 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:42.439848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerDied","Data":"d80d8fdd18dd5ecc135bccd146413a8d9a051f5b2a1773dec577782bf0b60746"} Sep 17 17:43:42.440314 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:42.439916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerStarted","Data":"d6afb112026788aa81d6a3fb73831b849dc808ab8e65f3ca7b0b27e5e5b87f77"} Sep 17 17:43:43.448885 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:43.448845 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerStarted","Data":"a6208681a54f6874d6aefce1376f390f58bfa546c0a8aaef0af9393d32a7e0e0"} Sep 17 17:43:43.449411 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:43.448942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerStarted","Data":"6a46d889441f43ccd1b70d2373c9f7ab422b4afb7b57d8d81589d09875efc2e7"} Sep 17 17:43:43.449411 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:43.448969 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerStarted","Data":"da019a4578befd64e2714efad3a9326596b3f5a70d7c9b53a30856a8cc413f17"} Sep 17 17:43:43.449411 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:43.448994 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerStarted","Data":"d7a2a70b78516dd5e2a8e37ce62215028d23cc96e17ec12e712ae24c89f9eaa5"} Sep 17 17:43:43.449411 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:43.449049 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerStarted","Data":"87a3ae7b777e804f30f42b62f61da570efbcedca9d9199fb8e5f0949cfea7f57"} Sep 17 17:43:43.449411 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:43.449074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657","Type":"ContainerStarted","Data":"95591a53bfd996e0746f960b6388f687624e36ed137efbbc69b1be6100de9841"} Sep 17 17:43:43.482687 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:43.482610 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.461887169 podStartE2EDuration="3.482583307s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.696138ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:43:43.480232086 +0000 UTC m=+153.324376115" watchObservedRunningTime="2026-09-17 17:43:43.482583307 +0000 UTC m=+153.326727337" Sep 17 17:43:45.736646 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:45.736597 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:45.737171 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:45.736723 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:45.741966 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:45.741935 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:46.144267 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:46.144223 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:43:46.466458 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:46.466357 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:43:46.521069 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:43:46.521026 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58ccd6559d-grgvx"] Sep 17 17:44:11.544415 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.544361 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58ccd6559d-grgvx" podUID="a831fe86-4c29-4f47-982b-83aa02104716" containerName="console" containerID="cri-o://68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5" gracePeriod=15 Sep 17 17:44:11.779419 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.779394 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:44:11.844220 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844155 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-oauth-config\") pod \"a831fe86-4c29-4f47-982b-83aa02104716\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " Sep 17 17:44:11.844359 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844242 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cdzl\" (UniqueName: \"kubernetes.io/projected/a831fe86-4c29-4f47-982b-83aa02104716-kube-api-access-2cdzl\") pod \"a831fe86-4c29-4f47-982b-83aa02104716\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " Sep 17 17:44:11.844359 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844275 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-console-config\") pod \"a831fe86-4c29-4f47-982b-83aa02104716\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " Sep 17 17:44:11.844359 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844307 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-trusted-ca-bundle\") pod \"a831fe86-4c29-4f47-982b-83aa02104716\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " Sep 17 17:44:11.844359 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844328 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-oauth-serving-cert\") pod \"a831fe86-4c29-4f47-982b-83aa02104716\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " Sep 17 17:44:11.844359 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844356 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-service-ca\") pod \"a831fe86-4c29-4f47-982b-83aa02104716\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " Sep 17 17:44:11.844606 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844372 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-serving-cert\") pod \"a831fe86-4c29-4f47-982b-83aa02104716\" (UID: \"a831fe86-4c29-4f47-982b-83aa02104716\") " Sep 17 17:44:11.844736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844702 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-console-config" (OuterVolumeSpecName: "console-config") pod "a831fe86-4c29-4f47-982b-83aa02104716" (UID: "a831fe86-4c29-4f47-982b-83aa02104716"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:44:11.844736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844705 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a831fe86-4c29-4f47-982b-83aa02104716" (UID: "a831fe86-4c29-4f47-982b-83aa02104716"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:44:11.844923 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844786 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-console-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:44:11.844923 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844804 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-trusted-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:44:11.844923 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844903 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a831fe86-4c29-4f47-982b-83aa02104716" (UID: "a831fe86-4c29-4f47-982b-83aa02104716"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:44:11.845135 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.844959 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-service-ca" (OuterVolumeSpecName: "service-ca") pod "a831fe86-4c29-4f47-982b-83aa02104716" (UID: "a831fe86-4c29-4f47-982b-83aa02104716"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:44:11.846447 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.846424 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a831fe86-4c29-4f47-982b-83aa02104716" (UID: "a831fe86-4c29-4f47-982b-83aa02104716"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:44:11.846538 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.846505 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a831fe86-4c29-4f47-982b-83aa02104716" (UID: "a831fe86-4c29-4f47-982b-83aa02104716"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:44:11.846588 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.846544 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a831fe86-4c29-4f47-982b-83aa02104716-kube-api-access-2cdzl" (OuterVolumeSpecName: "kube-api-access-2cdzl") pod "a831fe86-4c29-4f47-982b-83aa02104716" (UID: "a831fe86-4c29-4f47-982b-83aa02104716"). InnerVolumeSpecName "kube-api-access-2cdzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:44:11.946001 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.945972 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-oauth-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:44:11.946001 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.945996 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a831fe86-4c29-4f47-982b-83aa02104716-service-ca\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:44:11.946001 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.946025 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:44:11.946233 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.946039 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a831fe86-4c29-4f47-982b-83aa02104716-console-oauth-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:44:11.946233 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:11.946051 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cdzl\" (UniqueName: \"kubernetes.io/projected/a831fe86-4c29-4f47-982b-83aa02104716-kube-api-access-2cdzl\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:44:12.578468 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.578435 2575 generic.go:356] "Generic (PLEG): container finished" podID="a831fe86-4c29-4f47-982b-83aa02104716" containerID="68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5" exitCode=0 Sep 17 17:44:12.578827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.578494 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ccd6559d-grgvx" Sep 17 17:44:12.578827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.578503 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ccd6559d-grgvx" event={"ID":"a831fe86-4c29-4f47-982b-83aa02104716","Type":"ContainerDied","Data":"68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5"} Sep 17 17:44:12.578827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.578578 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ccd6559d-grgvx" event={"ID":"a831fe86-4c29-4f47-982b-83aa02104716","Type":"ContainerDied","Data":"1573007042faa667a1ddb72cc0f272c7ba66a9186a0e10aedaf4220f8e3b88cc"} Sep 17 17:44:12.578827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.578600 2575 scope.go:117] "RemoveContainer" containerID="68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5" Sep 17 17:44:12.586451 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.586437 2575 scope.go:117] "RemoveContainer" containerID="68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5" Sep 17 17:44:12.586718 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:44:12.586698 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5\": container with ID starting with 68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5 not found: ID does not exist" containerID="68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5" Sep 17 17:44:12.586809 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.586724 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5"} err="failed to get container status \"68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5\": rpc error: code = NotFound desc = could not find container \"68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5\": container with ID starting with 68e7aa88dbef2a7e53c382b67308f1b1594cf36df3aca4fbf8f667f8dade63e5 not found: ID does not exist" Sep 17 17:44:12.594059 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.594040 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58ccd6559d-grgvx"] Sep 17 17:44:12.597440 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:12.597420 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58ccd6559d-grgvx"] Sep 17 17:44:14.340560 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:14.340532 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a831fe86-4c29-4f47-982b-83aa02104716" path="/var/lib/kubelet/pods/a831fe86-4c29-4f47-982b-83aa02104716/volumes" Sep 17 17:44:41.145314 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:41.145279 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:44:41.160721 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:41.160696 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:44:41.714933 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:44:41.714905 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:46:12.224482 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:46:12.224447 2575 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 17:47:21.668976 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.668939 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bkrxs"] Sep 17 17:47:21.669436 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.669310 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a831fe86-4c29-4f47-982b-83aa02104716" containerName="console" Sep 17 17:47:21.669436 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.669322 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a831fe86-4c29-4f47-982b-83aa02104716" containerName="console" Sep 17 17:47:21.669436 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.669369 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a831fe86-4c29-4f47-982b-83aa02104716" containerName="console" Sep 17 17:47:21.672304 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.672288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:21.675328 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.675303 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 17:47:21.685667 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.685648 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 17:47:21.707096 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.707068 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bkrxs"] Sep 17 17:47:21.778563 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.778542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4af8f5d-b8e5-470c-a794-435646f4330a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bkrxs\" (UID: \"a4af8f5d-b8e5-470c-a794-435646f4330a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:21.778656 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.778578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzg9q\" (UniqueName: \"kubernetes.io/projected/a4af8f5d-b8e5-470c-a794-435646f4330a-kube-api-access-qzg9q\") pod \"cert-manager-webhook-6486ffd997-bkrxs\" (UID: \"a4af8f5d-b8e5-470c-a794-435646f4330a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:21.879677 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.879652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9q\" (UniqueName: \"kubernetes.io/projected/a4af8f5d-b8e5-470c-a794-435646f4330a-kube-api-access-qzg9q\") pod \"cert-manager-webhook-6486ffd997-bkrxs\" (UID: \"a4af8f5d-b8e5-470c-a794-435646f4330a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:21.879761 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.879719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4af8f5d-b8e5-470c-a794-435646f4330a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bkrxs\" (UID: \"a4af8f5d-b8e5-470c-a794-435646f4330a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:21.889998 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.889971 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4af8f5d-b8e5-470c-a794-435646f4330a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bkrxs\" (UID: \"a4af8f5d-b8e5-470c-a794-435646f4330a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:21.891483 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.891465 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzg9q\" (UniqueName: \"kubernetes.io/projected/a4af8f5d-b8e5-470c-a794-435646f4330a-kube-api-access-qzg9q\") pod \"cert-manager-webhook-6486ffd997-bkrxs\" (UID: \"a4af8f5d-b8e5-470c-a794-435646f4330a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:21.993034 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:21.992971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:22.276882 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:22.276849 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bkrxs"] Sep 17 17:47:22.281681 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:47:22.281650 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4af8f5d_b8e5_470c_a794_435646f4330a.slice/crio-07765e5aba1d541f1c49029db7fd2d38708805d6baddf0eed322da5c3090d156 WatchSource:0}: Error finding container 07765e5aba1d541f1c49029db7fd2d38708805d6baddf0eed322da5c3090d156: Status 404 returned error can't find the container with id 07765e5aba1d541f1c49029db7fd2d38708805d6baddf0eed322da5c3090d156 Sep 17 17:47:22.283609 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:22.283588 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:47:22.333368 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:22.333344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" event={"ID":"a4af8f5d-b8e5-470c-a794-435646f4330a","Type":"ContainerStarted","Data":"07765e5aba1d541f1c49029db7fd2d38708805d6baddf0eed322da5c3090d156"} Sep 17 17:47:24.952639 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:24.952606 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf"] Sep 17 17:47:24.955976 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:24.955958 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:24.957901 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:24.957881 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pljnd\"" Sep 17 17:47:24.965717 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:24.965688 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf"] Sep 17 17:47:25.000761 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.000729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b4ae243-366e-4578-bc3b-9adbd3d71014-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tqnxf\" (UID: \"5b4ae243-366e-4578-bc3b-9adbd3d71014\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:25.000856 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.000814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cldnz\" (UniqueName: \"kubernetes.io/projected/5b4ae243-366e-4578-bc3b-9adbd3d71014-kube-api-access-cldnz\") pod \"cert-manager-cainjector-559cdd8c87-tqnxf\" (UID: \"5b4ae243-366e-4578-bc3b-9adbd3d71014\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:25.102150 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.102123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b4ae243-366e-4578-bc3b-9adbd3d71014-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tqnxf\" (UID: \"5b4ae243-366e-4578-bc3b-9adbd3d71014\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:25.102265 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.102177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cldnz\" (UniqueName: \"kubernetes.io/projected/5b4ae243-366e-4578-bc3b-9adbd3d71014-kube-api-access-cldnz\") pod \"cert-manager-cainjector-559cdd8c87-tqnxf\" (UID: \"5b4ae243-366e-4578-bc3b-9adbd3d71014\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:25.120544 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.120502 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b4ae243-366e-4578-bc3b-9adbd3d71014-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tqnxf\" (UID: \"5b4ae243-366e-4578-bc3b-9adbd3d71014\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:25.120845 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.120828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cldnz\" (UniqueName: \"kubernetes.io/projected/5b4ae243-366e-4578-bc3b-9adbd3d71014-kube-api-access-cldnz\") pod \"cert-manager-cainjector-559cdd8c87-tqnxf\" (UID: \"5b4ae243-366e-4578-bc3b-9adbd3d71014\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:25.266916 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.266891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" Sep 17 17:47:25.599354 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:25.599324 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf"] Sep 17 17:47:25.601439 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:47:25.601413 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b4ae243_366e_4578_bc3b_9adbd3d71014.slice/crio-90b85947df82b50287667780c167013d348835d3b2ce3832d4b108c31a7be756 WatchSource:0}: Error finding container 90b85947df82b50287667780c167013d348835d3b2ce3832d4b108c31a7be756: Status 404 returned error can't find the container with id 90b85947df82b50287667780c167013d348835d3b2ce3832d4b108c31a7be756 Sep 17 17:47:26.351215 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:26.351182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" event={"ID":"5b4ae243-366e-4578-bc3b-9adbd3d71014","Type":"ContainerStarted","Data":"e80ce6760f2bf879c9fbbf42bffc0c9f4fa6f66b7a99e2cdf6c711d05a6782bc"} Sep 17 17:47:26.351598 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:26.351221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" event={"ID":"5b4ae243-366e-4578-bc3b-9adbd3d71014","Type":"ContainerStarted","Data":"90b85947df82b50287667780c167013d348835d3b2ce3832d4b108c31a7be756"} Sep 17 17:47:26.352839 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:26.352819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" event={"ID":"a4af8f5d-b8e5-470c-a794-435646f4330a","Type":"ContainerStarted","Data":"3a1ff3f5a51c55c3e74638d465bfa7fa6307a510cb977193b9b0b139b18fbcac"} Sep 17 17:47:26.352914 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:26.352886 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:26.369506 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:26.369447 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqnxf" podStartSLOduration=2.369433218 podStartE2EDuration="2.369433218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:26.368267586 +0000 UTC m=+376.212411614" watchObservedRunningTime="2026-09-17 17:47:26.369433218 +0000 UTC m=+376.213577239" Sep 17 17:47:26.388363 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:26.388322 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" podStartSLOduration=2.269653238 podStartE2EDuration="5.388305101s" totalImagesPullingTime="3.118651863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:26.387205064 +0000 UTC m=+376.231349092" watchObservedRunningTime="2026-09-17 17:47:26.388305101 +0000 UTC m=+376.232449129" Sep 17 17:47:32.360665 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:32.360632 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bkrxs" Sep 17 17:47:33.802068 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.802031 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f975dcdd8-jbrl7"] Sep 17 17:47:33.805764 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.805742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.822895 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.822871 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f975dcdd8-jbrl7"] Sep 17 17:47:33.865164 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.865141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvmn2\" (UniqueName: \"kubernetes.io/projected/8c0bfe0e-2f46-4b30-a188-22fe9a151055-kube-api-access-gvmn2\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.865257 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.865167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-serving-cert\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.865257 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.865185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-service-ca\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.865257 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.865206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-trusted-ca-bundle\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.865416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.865290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-oauth-serving-cert\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.865416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.865361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-config\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.865495 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.865402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-oauth-config\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.966471 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.966442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-oauth-serving-cert\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.966572 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.966486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-config\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.966572 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.966508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-oauth-config\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.966572 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.966543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvmn2\" (UniqueName: \"kubernetes.io/projected/8c0bfe0e-2f46-4b30-a188-22fe9a151055-kube-api-access-gvmn2\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.966730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.966611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-serving-cert\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.966730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.966635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-service-ca\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.966730 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.966671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-trusted-ca-bundle\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.967344 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.967319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-oauth-serving-cert\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.967490 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.967386 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-config\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.967490 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.967408 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-service-ca\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.967657 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.967635 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c0bfe0e-2f46-4b30-a188-22fe9a151055-trusted-ca-bundle\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.969334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.969304 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-serving-cert\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.969334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.969321 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0bfe0e-2f46-4b30-a188-22fe9a151055-console-oauth-config\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:33.974485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:33.974463 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvmn2\" (UniqueName: \"kubernetes.io/projected/8c0bfe0e-2f46-4b30-a188-22fe9a151055-kube-api-access-gvmn2\") pod \"console-f975dcdd8-jbrl7\" (UID: \"8c0bfe0e-2f46-4b30-a188-22fe9a151055\") " pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:34.115690 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:34.115620 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:34.393159 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:34.393087 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f975dcdd8-jbrl7"] Sep 17 17:47:34.395824 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:47:34.395802 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0bfe0e_2f46_4b30_a188_22fe9a151055.slice/crio-c0e8e0f90e1c03a0d4e5e481ad49ab9b69d3c346eb80ed9bec1ccdcbdb1912a3 WatchSource:0}: Error finding container c0e8e0f90e1c03a0d4e5e481ad49ab9b69d3c346eb80ed9bec1ccdcbdb1912a3: Status 404 returned error can't find the container with id c0e8e0f90e1c03a0d4e5e481ad49ab9b69d3c346eb80ed9bec1ccdcbdb1912a3 Sep 17 17:47:35.396811 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:35.396770 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f975dcdd8-jbrl7" event={"ID":"8c0bfe0e-2f46-4b30-a188-22fe9a151055","Type":"ContainerStarted","Data":"fd71f3669e832011dd07882ce11b2637d5a561d7bf34af50d2c8c2ef1a51f25a"} Sep 17 17:47:35.397190 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:35.396824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f975dcdd8-jbrl7" event={"ID":"8c0bfe0e-2f46-4b30-a188-22fe9a151055","Type":"ContainerStarted","Data":"c0e8e0f90e1c03a0d4e5e481ad49ab9b69d3c346eb80ed9bec1ccdcbdb1912a3"} Sep 17 17:47:35.417347 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:35.417298 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f975dcdd8-jbrl7" podStartSLOduration=2.417282594 podStartE2EDuration="2.417282594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:35.415321963 +0000 UTC m=+385.259465991" watchObservedRunningTime="2026-09-17 17:47:35.417282594 +0000 UTC m=+385.261426620" Sep 17 17:47:40.774455 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.774424 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8"] Sep 17 17:47:40.777963 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.777946 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:40.780211 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.780191 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-d6xtj\"" Sep 17 17:47:40.780333 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.780231 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 17:47:40.780644 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.780627 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:47:40.787545 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.787517 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8"] Sep 17 17:47:40.821339 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.821318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ef9543f-e1dc-4378-91c0-730ba1891c68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wjhw8\" (UID: \"3ef9543f-e1dc-4378-91c0-730ba1891c68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:40.821457 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.821348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n46c\" (UniqueName: \"kubernetes.io/projected/3ef9543f-e1dc-4378-91c0-730ba1891c68-kube-api-access-5n46c\") pod \"openshift-lws-operator-fd8ccff4c-wjhw8\" (UID: \"3ef9543f-e1dc-4378-91c0-730ba1891c68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:40.921757 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.921729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ef9543f-e1dc-4378-91c0-730ba1891c68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wjhw8\" (UID: \"3ef9543f-e1dc-4378-91c0-730ba1891c68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:40.921855 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.921761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n46c\" (UniqueName: \"kubernetes.io/projected/3ef9543f-e1dc-4378-91c0-730ba1891c68-kube-api-access-5n46c\") pod \"openshift-lws-operator-fd8ccff4c-wjhw8\" (UID: \"3ef9543f-e1dc-4378-91c0-730ba1891c68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:40.922110 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.922092 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ef9543f-e1dc-4378-91c0-730ba1891c68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wjhw8\" (UID: \"3ef9543f-e1dc-4378-91c0-730ba1891c68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:40.929604 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:40.929579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n46c\" (UniqueName: \"kubernetes.io/projected/3ef9543f-e1dc-4378-91c0-730ba1891c68-kube-api-access-5n46c\") pod \"openshift-lws-operator-fd8ccff4c-wjhw8\" (UID: \"3ef9543f-e1dc-4378-91c0-730ba1891c68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:41.089038 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:41.088957 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" Sep 17 17:47:41.376370 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:41.376340 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8"] Sep 17 17:47:41.377776 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:47:41.377745 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ef9543f_e1dc_4378_91c0_730ba1891c68.slice/crio-a0da40fba502e7664312dbad36085fccdbf4061758f77c7c00c4694314814c94 WatchSource:0}: Error finding container a0da40fba502e7664312dbad36085fccdbf4061758f77c7c00c4694314814c94: Status 404 returned error can't find the container with id a0da40fba502e7664312dbad36085fccdbf4061758f77c7c00c4694314814c94 Sep 17 17:47:41.422874 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:41.422844 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" event={"ID":"3ef9543f-e1dc-4378-91c0-730ba1891c68","Type":"ContainerStarted","Data":"a0da40fba502e7664312dbad36085fccdbf4061758f77c7c00c4694314814c94"} Sep 17 17:47:44.115843 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:44.115815 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:44.116194 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:44.115871 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:44.120827 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:44.120804 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:44.439103 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:44.439070 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" event={"ID":"3ef9543f-e1dc-4378-91c0-730ba1891c68","Type":"ContainerStarted","Data":"7a9924637caf5434bbf0dfda90af42f60617d46103b76b9c6b1078b5618b57f1"} Sep 17 17:47:44.442593 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:44.442571 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f975dcdd8-jbrl7" Sep 17 17:47:44.455843 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:44.455807 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wjhw8" podStartSLOduration=1.868398365 podStartE2EDuration="4.455793171s" totalImagesPullingTime="2.587394806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:44.454617691 +0000 UTC m=+394.298761715" watchObservedRunningTime="2026-09-17 17:47:44.455793171 +0000 UTC m=+394.299937197" Sep 17 17:47:44.516454 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:47:44.516431 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cb889547-sh9xl"] Sep 17 17:48:09.538731 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.538684 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69cb889547-sh9xl" podUID="81a5e788-0444-48dc-a633-1d75ba6cd9aa" containerName="console" containerID="cri-o://6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605" gracePeriod=15 Sep 17 17:48:09.769896 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.769873 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:48:09.855290 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855214 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-config\") pod \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " Sep 17 17:48:09.855290 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855268 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-oauth-serving-cert\") pod \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " Sep 17 17:48:09.855290 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855291 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmhwx\" (UniqueName: \"kubernetes.io/projected/81a5e788-0444-48dc-a633-1d75ba6cd9aa-kube-api-access-lmhwx\") pod \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " Sep 17 17:48:09.855502 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855326 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-service-ca\") pod \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " Sep 17 17:48:09.855502 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855365 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-oauth-config\") pod \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " Sep 17 17:48:09.855502 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855398 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-serving-cert\") pod \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " Sep 17 17:48:09.855502 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855424 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-trusted-ca-bundle\") pod \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\" (UID: \"81a5e788-0444-48dc-a633-1d75ba6cd9aa\") " Sep 17 17:48:09.855707 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855680 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-config" (OuterVolumeSpecName: "console-config") pod "81a5e788-0444-48dc-a633-1d75ba6cd9aa" (UID: "81a5e788-0444-48dc-a633-1d75ba6cd9aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:48:09.855769 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855718 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81a5e788-0444-48dc-a633-1d75ba6cd9aa" (UID: "81a5e788-0444-48dc-a633-1d75ba6cd9aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:48:09.855890 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855861 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "81a5e788-0444-48dc-a633-1d75ba6cd9aa" (UID: "81a5e788-0444-48dc-a633-1d75ba6cd9aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:48:09.856027 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.855990 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81a5e788-0444-48dc-a633-1d75ba6cd9aa" (UID: "81a5e788-0444-48dc-a633-1d75ba6cd9aa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:48:09.857392 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.857371 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81a5e788-0444-48dc-a633-1d75ba6cd9aa" (UID: "81a5e788-0444-48dc-a633-1d75ba6cd9aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:48:09.857474 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.857398 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a5e788-0444-48dc-a633-1d75ba6cd9aa-kube-api-access-lmhwx" (OuterVolumeSpecName: "kube-api-access-lmhwx") pod "81a5e788-0444-48dc-a633-1d75ba6cd9aa" (UID: "81a5e788-0444-48dc-a633-1d75ba6cd9aa"). InnerVolumeSpecName "kube-api-access-lmhwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:48:09.857511 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.857471 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81a5e788-0444-48dc-a633-1d75ba6cd9aa" (UID: "81a5e788-0444-48dc-a633-1d75ba6cd9aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:48:09.956971 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.956944 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-oauth-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:48:09.956971 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.956967 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:48:09.956971 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.956975 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-trusted-ca-bundle\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:48:09.957158 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.956984 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-console-config\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:48:09.957158 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.956993 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-oauth-serving-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:48:09.957158 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.957001 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmhwx\" (UniqueName: \"kubernetes.io/projected/81a5e788-0444-48dc-a633-1d75ba6cd9aa-kube-api-access-lmhwx\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:48:09.957158 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:09.957029 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a5e788-0444-48dc-a633-1d75ba6cd9aa-service-ca\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:48:10.544896 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.544870 2575 generic.go:356] "Generic (PLEG): container finished" podID="81a5e788-0444-48dc-a633-1d75ba6cd9aa" containerID="6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605" exitCode=0 Sep 17 17:48:10.545247 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.544911 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb889547-sh9xl" Sep 17 17:48:10.545247 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.544910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb889547-sh9xl" event={"ID":"81a5e788-0444-48dc-a633-1d75ba6cd9aa","Type":"ContainerDied","Data":"6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605"} Sep 17 17:48:10.545247 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.544962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb889547-sh9xl" event={"ID":"81a5e788-0444-48dc-a633-1d75ba6cd9aa","Type":"ContainerDied","Data":"d7973d9f4e7da8d0922eabc6282724cc8ebdcfccc2b076a48f6b58809740ad76"} Sep 17 17:48:10.545247 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.544989 2575 scope.go:117] "RemoveContainer" containerID="6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605" Sep 17 17:48:10.553087 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.553072 2575 scope.go:117] "RemoveContainer" containerID="6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605" Sep 17 17:48:10.553337 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:48:10.553321 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605\": container with ID starting with 6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605 not found: ID does not exist" containerID="6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605" Sep 17 17:48:10.553383 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.553345 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605"} err="failed to get container status \"6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605\": rpc error: code = NotFound desc = could not find container \"6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605\": container with ID starting with 6ad1ccab0e298750770cd23a980770e7c9133eab1e962560c48a397cd8dc7605 not found: ID does not exist" Sep 17 17:48:10.560260 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.560241 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cb889547-sh9xl"] Sep 17 17:48:10.564980 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:10.564961 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69cb889547-sh9xl"] Sep 17 17:48:12.153533 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.153502 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn"] Sep 17 17:48:12.153995 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.153829 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a5e788-0444-48dc-a633-1d75ba6cd9aa" containerName="console" Sep 17 17:48:12.153995 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.153839 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a5e788-0444-48dc-a633-1d75ba6cd9aa" containerName="console" Sep 17 17:48:12.153995 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.153914 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a5e788-0444-48dc-a633-1d75ba6cd9aa" containerName="console" Sep 17 17:48:12.160388 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.160369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.163187 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.163166 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 17:48:12.163485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.163463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 17:48:12.163832 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.163816 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 17:48:12.163907 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.163817 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8v7sm\"" Sep 17 17:48:12.177847 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.177825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn"] Sep 17 17:48:12.273400 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.273376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-cert\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.273484 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.273425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-manager-config\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.273484 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.273453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-metrics-cert\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.273484 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.273470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp67q\" (UniqueName: \"kubernetes.io/projected/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-kube-api-access-rp67q\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.341383 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.341361 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a5e788-0444-48dc-a633-1d75ba6cd9aa" path="/var/lib/kubelet/pods/81a5e788-0444-48dc-a633-1d75ba6cd9aa/volumes" Sep 17 17:48:12.374797 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.374773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp67q\" (UniqueName: \"kubernetes.io/projected/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-kube-api-access-rp67q\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.374886 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.374823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-cert\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.374886 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.374863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-manager-config\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.374886 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.374877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-metrics-cert\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.375644 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.375608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-manager-config\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.377334 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.377298 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-metrics-cert\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.377436 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.377410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-cert\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.389984 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.389953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp67q\" (UniqueName: \"kubernetes.io/projected/056eeb71-4f39-4df2-808f-c9c2ec6b0a62-kube-api-access-rp67q\") pod \"lws-controller-manager-68dc9b9bc-djqwn\" (UID: \"056eeb71-4f39-4df2-808f-c9c2ec6b0a62\") " pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.469617 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.469567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:12.740813 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:12.740788 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn"] Sep 17 17:48:12.743032 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:48:12.742978 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056eeb71_4f39_4df2_808f_c9c2ec6b0a62.slice/crio-e8d460a22712adae04c5e4bc8bb1e2d1bc5055973979b86db61ef2fbadcf1817 WatchSource:0}: Error finding container e8d460a22712adae04c5e4bc8bb1e2d1bc5055973979b86db61ef2fbadcf1817: Status 404 returned error can't find the container with id e8d460a22712adae04c5e4bc8bb1e2d1bc5055973979b86db61ef2fbadcf1817 Sep 17 17:48:13.559913 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:13.559874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" event={"ID":"056eeb71-4f39-4df2-808f-c9c2ec6b0a62","Type":"ContainerStarted","Data":"e8d460a22712adae04c5e4bc8bb1e2d1bc5055973979b86db61ef2fbadcf1817"} Sep 17 17:48:14.567196 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:14.567161 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" event={"ID":"056eeb71-4f39-4df2-808f-c9c2ec6b0a62","Type":"ContainerStarted","Data":"e0dc3ec6aba11bd03cef43ad7eef1bd78bf74e50e51ea5942bea70370d5a6c9a"} Sep 17 17:48:14.567643 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:14.567232 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:14.589449 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:14.589390 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" podStartSLOduration=1.398091747 podStartE2EDuration="2.589371436s" totalImagesPullingTime="1.191279689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:48:14.58840406 +0000 UTC m=+424.432548087" watchObservedRunningTime="2026-09-17 17:48:14.589371436 +0000 UTC m=+424.433515465" Sep 17 17:48:25.573129 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:25.573053 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68dc9b9bc-djqwn" Sep 17 17:48:28.482854 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.482824 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx"] Sep 17 17:48:28.484998 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.484983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" Sep 17 17:48:28.487309 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.487290 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 17:48:28.487433 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.487313 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 17:48:28.487542 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.487524 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nfwqf\"" Sep 17 17:48:28.487591 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.487529 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 17 17:48:28.490380 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.490356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvk2k\" (UniqueName: \"kubernetes.io/projected/abcb04e0-e6a2-44e9-ab22-7686e68f4997-kube-api-access-qvk2k\") pod \"dns-operator-controller-manager-65dc8f76f5-rnwzx\" (UID: \"abcb04e0-e6a2-44e9-ab22-7686e68f4997\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" Sep 17 17:48:28.503639 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.503619 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx"] Sep 17 17:48:28.591185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.591161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvk2k\" (UniqueName: \"kubernetes.io/projected/abcb04e0-e6a2-44e9-ab22-7686e68f4997-kube-api-access-qvk2k\") pod \"dns-operator-controller-manager-65dc8f76f5-rnwzx\" (UID: \"abcb04e0-e6a2-44e9-ab22-7686e68f4997\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" Sep 17 17:48:28.599408 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.599383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvk2k\" (UniqueName: \"kubernetes.io/projected/abcb04e0-e6a2-44e9-ab22-7686e68f4997-kube-api-access-qvk2k\") pod \"dns-operator-controller-manager-65dc8f76f5-rnwzx\" (UID: \"abcb04e0-e6a2-44e9-ab22-7686e68f4997\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" Sep 17 17:48:28.795089 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:28.795068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" Sep 17 17:48:29.072736 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:29.072713 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx"] Sep 17 17:48:29.074597 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:48:29.074571 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabcb04e0_e6a2_44e9_ab22_7686e68f4997.slice/crio-66b2989bc10456a8ff30f28dcba098c970fee023a868e5beb9a2f46ae4b38985 WatchSource:0}: Error finding container 66b2989bc10456a8ff30f28dcba098c970fee023a868e5beb9a2f46ae4b38985: Status 404 returned error can't find the container with id 66b2989bc10456a8ff30f28dcba098c970fee023a868e5beb9a2f46ae4b38985 Sep 17 17:48:29.634604 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:29.634573 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" event={"ID":"abcb04e0-e6a2-44e9-ab22-7686e68f4997","Type":"ContainerStarted","Data":"66b2989bc10456a8ff30f28dcba098c970fee023a868e5beb9a2f46ae4b38985"} Sep 17 17:48:31.163172 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.163143 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-jzt6h"] Sep 17 17:48:31.166252 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.166235 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" Sep 17 17:48:31.169340 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.169321 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5qzn8\"" Sep 17 17:48:31.185039 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.184997 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-jzt6h"] Sep 17 17:48:31.211150 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.211113 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcghp\" (UniqueName: \"kubernetes.io/projected/1d0e2912-29c4-4a3f-acb7-92ea08f24903-kube-api-access-kcghp\") pod \"authorino-operator-6fc8f864f4-jzt6h\" (UID: \"1d0e2912-29c4-4a3f-acb7-92ea08f24903\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" Sep 17 17:48:31.311672 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.311646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcghp\" (UniqueName: \"kubernetes.io/projected/1d0e2912-29c4-4a3f-acb7-92ea08f24903-kube-api-access-kcghp\") pod \"authorino-operator-6fc8f864f4-jzt6h\" (UID: \"1d0e2912-29c4-4a3f-acb7-92ea08f24903\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" Sep 17 17:48:31.325837 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.325807 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcghp\" (UniqueName: \"kubernetes.io/projected/1d0e2912-29c4-4a3f-acb7-92ea08f24903-kube-api-access-kcghp\") pod \"authorino-operator-6fc8f864f4-jzt6h\" (UID: \"1d0e2912-29c4-4a3f-acb7-92ea08f24903\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" Sep 17 17:48:31.475923 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.475871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" Sep 17 17:48:31.744223 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:31.744158 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-jzt6h"] Sep 17 17:48:31.747164 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:48:31.747127 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d0e2912_29c4_4a3f_acb7_92ea08f24903.slice/crio-cb2851d3d9358bd9e5951c1adce60fdf8141301c830fc88fa85e544cd92e2e12 WatchSource:0}: Error finding container cb2851d3d9358bd9e5951c1adce60fdf8141301c830fc88fa85e544cd92e2e12: Status 404 returned error can't find the container with id cb2851d3d9358bd9e5951c1adce60fdf8141301c830fc88fa85e544cd92e2e12 Sep 17 17:48:32.652257 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:32.652202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" event={"ID":"1d0e2912-29c4-4a3f-acb7-92ea08f24903","Type":"ContainerStarted","Data":"cb2851d3d9358bd9e5951c1adce60fdf8141301c830fc88fa85e544cd92e2e12"} Sep 17 17:48:34.663346 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:34.663305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" event={"ID":"1d0e2912-29c4-4a3f-acb7-92ea08f24903","Type":"ContainerStarted","Data":"940150f081fe4db57de65578e9156eb22ee54ff69c2e683cde5abc692d136438"} Sep 17 17:48:34.663755 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:34.663366 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" Sep 17 17:48:34.664865 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:34.664843 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" event={"ID":"abcb04e0-e6a2-44e9-ab22-7686e68f4997","Type":"ContainerStarted","Data":"07ef43ad1cc5e65e5f7fe322596ddc6c451632aeba25ce4abbae81545f8a78c3"} Sep 17 17:48:34.664969 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:34.664908 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" Sep 17 17:48:34.688620 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:34.688572 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" podStartSLOduration=0.92847086 podStartE2EDuration="3.688554945s" totalImagesPullingTime="2.760084085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:48:34.687837089 +0000 UTC m=+444.531981116" watchObservedRunningTime="2026-09-17 17:48:34.688554945 +0000 UTC m=+444.532698977" Sep 17 17:48:34.726089 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:34.726046 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" podStartSLOduration=1.290782032 podStartE2EDuration="6.726033156s" totalImagesPullingTime="5.435251124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:48:34.723886402 +0000 UTC m=+444.568030432" watchObservedRunningTime="2026-09-17 17:48:34.726033156 +0000 UTC m=+444.570177181" Sep 17 17:48:45.670440 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:45.670410 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-rnwzx" Sep 17 17:48:45.670894 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:48:45.670477 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6fc8f864f4-jzt6h" Sep 17 17:49:19.961714 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:19.961686 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pvtwv"] Sep 17 17:49:19.967182 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:19.967161 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:19.969028 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:19.968997 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2gct4\"" Sep 17 17:49:19.969188 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:19.969169 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 17:49:19.975423 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:19.975402 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pvtwv"] Sep 17 17:49:20.054790 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.054766 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pvtwv"] Sep 17 17:49:20.082394 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.082372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2207bec-7d86-4537-87a9-7fa798effedc-config-file\") pod \"limitador-limitador-8588749977-pvtwv\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:20.082510 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.082429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5spck\" (UniqueName: \"kubernetes.io/projected/e2207bec-7d86-4537-87a9-7fa798effedc-kube-api-access-5spck\") pod \"limitador-limitador-8588749977-pvtwv\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:20.183050 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.183002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2207bec-7d86-4537-87a9-7fa798effedc-config-file\") pod \"limitador-limitador-8588749977-pvtwv\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:20.183152 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.183084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5spck\" (UniqueName: \"kubernetes.io/projected/e2207bec-7d86-4537-87a9-7fa798effedc-kube-api-access-5spck\") pod \"limitador-limitador-8588749977-pvtwv\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:20.183575 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.183557 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2207bec-7d86-4537-87a9-7fa798effedc-config-file\") pod \"limitador-limitador-8588749977-pvtwv\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:20.191485 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.191463 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5spck\" (UniqueName: \"kubernetes.io/projected/e2207bec-7d86-4537-87a9-7fa798effedc-kube-api-access-5spck\") pod \"limitador-limitador-8588749977-pvtwv\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:20.277774 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.277755 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:20.553185 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.553160 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pvtwv"] Sep 17 17:49:20.555478 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:49:20.555449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2207bec_7d86_4537_87a9_7fa798effedc.slice/crio-7e75b1f6b944ed1dd9bc424f0fe63737b669203f95c1fd049ccffbf90c92d3b4 WatchSource:0}: Error finding container 7e75b1f6b944ed1dd9bc424f0fe63737b669203f95c1fd049ccffbf90c92d3b4: Status 404 returned error can't find the container with id 7e75b1f6b944ed1dd9bc424f0fe63737b669203f95c1fd049ccffbf90c92d3b4 Sep 17 17:49:20.868189 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:20.868117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" event={"ID":"e2207bec-7d86-4537-87a9-7fa798effedc","Type":"ContainerStarted","Data":"7e75b1f6b944ed1dd9bc424f0fe63737b669203f95c1fd049ccffbf90c92d3b4"} Sep 17 17:49:21.873962 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:21.873934 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" event={"ID":"e2207bec-7d86-4537-87a9-7fa798effedc","Type":"ContainerStarted","Data":"b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf"} Sep 17 17:49:21.874285 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:21.874048 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:21.893174 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:21.893129 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" podStartSLOduration=1.679987359 podStartE2EDuration="2.893114421s" totalImagesPullingTime="1.213127062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:49:21.892238165 +0000 UTC m=+491.736382195" watchObservedRunningTime="2026-09-17 17:49:21.893114421 +0000 UTC m=+491.737258448" Sep 17 17:49:32.878623 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:32.878595 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:33.856633 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:33.856603 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pvtwv"] Sep 17 17:49:33.856846 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:33.856800 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" podUID="e2207bec-7d86-4537-87a9-7fa798effedc" containerName="limitador" containerID="cri-o://b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf" gracePeriod=30 Sep 17 17:49:34.790085 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.790057 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:34.891350 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.891320 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2207bec-7d86-4537-87a9-7fa798effedc-config-file\") pod \"e2207bec-7d86-4537-87a9-7fa798effedc\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " Sep 17 17:49:34.891477 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.891356 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5spck\" (UniqueName: \"kubernetes.io/projected/e2207bec-7d86-4537-87a9-7fa798effedc-kube-api-access-5spck\") pod \"e2207bec-7d86-4537-87a9-7fa798effedc\" (UID: \"e2207bec-7d86-4537-87a9-7fa798effedc\") " Sep 17 17:49:34.891704 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.891685 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2207bec-7d86-4537-87a9-7fa798effedc-config-file" (OuterVolumeSpecName: "config-file") pod "e2207bec-7d86-4537-87a9-7fa798effedc" (UID: "e2207bec-7d86-4537-87a9-7fa798effedc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:34.893428 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.893403 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2207bec-7d86-4537-87a9-7fa798effedc-kube-api-access-5spck" (OuterVolumeSpecName: "kube-api-access-5spck") pod "e2207bec-7d86-4537-87a9-7fa798effedc" (UID: "e2207bec-7d86-4537-87a9-7fa798effedc"). InnerVolumeSpecName "kube-api-access-5spck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:49:34.930760 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.930695 2575 generic.go:356] "Generic (PLEG): container finished" podID="e2207bec-7d86-4537-87a9-7fa798effedc" containerID="b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf" exitCode=0 Sep 17 17:49:34.930760 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.930741 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" Sep 17 17:49:34.930897 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.930777 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" event={"ID":"e2207bec-7d86-4537-87a9-7fa798effedc","Type":"ContainerDied","Data":"b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf"} Sep 17 17:49:34.930897 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.930816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pvtwv" event={"ID":"e2207bec-7d86-4537-87a9-7fa798effedc","Type":"ContainerDied","Data":"7e75b1f6b944ed1dd9bc424f0fe63737b669203f95c1fd049ccffbf90c92d3b4"} Sep 17 17:49:34.930897 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.930837 2575 scope.go:117] "RemoveContainer" containerID="b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf" Sep 17 17:49:34.939079 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.939063 2575 scope.go:117] "RemoveContainer" containerID="b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf" Sep 17 17:49:34.939334 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:49:34.939317 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf\": container with ID starting with b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf not found: ID does not exist" containerID="b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf" Sep 17 17:49:34.939376 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.939344 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf"} err="failed to get container status \"b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf\": rpc error: code = NotFound desc = could not find container \"b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf\": container with ID starting with b09371376de24392e64e0a057c9a800813d665d4812aa7c6046d195dd07d22bf not found: ID does not exist" Sep 17 17:49:34.950897 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.950872 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pvtwv"] Sep 17 17:49:34.954158 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.954140 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pvtwv"] Sep 17 17:49:34.992959 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.992933 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2207bec-7d86-4537-87a9-7fa798effedc-config-file\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:49:34.992959 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:34.992956 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5spck\" (UniqueName: \"kubernetes.io/projected/e2207bec-7d86-4537-87a9-7fa798effedc-kube-api-access-5spck\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:49:36.340366 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:49:36.340338 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2207bec-7d86-4537-87a9-7fa798effedc" path="/var/lib/kubelet/pods/e2207bec-7d86-4537-87a9-7fa798effedc/volumes" Sep 17 17:50:03.673577 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.673507 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh"] Sep 17 17:50:03.674045 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.673870 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2207bec-7d86-4537-87a9-7fa798effedc" containerName="limitador" Sep 17 17:50:03.674045 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.673882 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2207bec-7d86-4537-87a9-7fa798effedc" containerName="limitador" Sep 17 17:50:03.674045 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.673941 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2207bec-7d86-4537-87a9-7fa798effedc" containerName="limitador" Sep 17 17:50:03.677665 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.677648 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.680995 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.680971 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 17 17:50:03.681186 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.681084 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 17 17:50:03.681360 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.681346 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s5vcf\"" Sep 17 17:50:03.681514 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.681475 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 17 17:50:03.681677 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.681662 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 17 17:50:03.681745 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.681705 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 17:50:03.681745 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.681719 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 17:50:03.693252 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.693231 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh"] Sep 17 17:50:03.704419 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.704396 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.704517 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.704431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce1d734-673c-41c3-8b28-5bc20c657725-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.704517 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.704454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87qk\" (UniqueName: \"kubernetes.io/projected/0ce1d734-673c-41c3-8b28-5bc20c657725-kube-api-access-r87qk\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.704517 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.704482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.704856 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.704533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.704856 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.704557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.704856 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.704582 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.805589 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.805563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.805703 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.805600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce1d734-673c-41c3-8b28-5bc20c657725-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.805703 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.805627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87qk\" (UniqueName: \"kubernetes.io/projected/0ce1d734-673c-41c3-8b28-5bc20c657725-kube-api-access-r87qk\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.805703 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.805652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.805878 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.805721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.805878 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.805746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.805878 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.805785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.806484 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.806465 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.807816 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.807796 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce1d734-673c-41c3-8b28-5bc20c657725-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.807984 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.807968 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.808318 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.808298 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.808384 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.808326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.813710 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.813690 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce1d734-673c-41c3-8b28-5bc20c657725-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.818147 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.818097 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87qk\" (UniqueName: \"kubernetes.io/projected/0ce1d734-673c-41c3-8b28-5bc20c657725-kube-api-access-r87qk\") pod \"istiod-openshift-gateway-5677ccb49b-qjwmh\" (UID: \"0ce1d734-673c-41c3-8b28-5bc20c657725\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:03.987346 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:03.987288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:04.274033 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:04.273996 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh"] Sep 17 17:50:04.276666 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:50:04.276645 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce1d734_673c_41c3_8b28_5bc20c657725.slice/crio-8a096f98e67894713467684d250bf080863ff5fbfa4ac77a12ec76929f913813 WatchSource:0}: Error finding container 8a096f98e67894713467684d250bf080863ff5fbfa4ac77a12ec76929f913813: Status 404 returned error can't find the container with id 8a096f98e67894713467684d250bf080863ff5fbfa4ac77a12ec76929f913813 Sep 17 17:50:05.063851 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:05.063819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" event={"ID":"0ce1d734-673c-41c3-8b28-5bc20c657725","Type":"ContainerStarted","Data":"8a096f98e67894713467684d250bf080863ff5fbfa4ac77a12ec76929f913813"} Sep 17 17:50:06.901830 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:06.901797 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 17:50:06.902084 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:06.901865 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 17:50:07.075301 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:07.075266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" event={"ID":"0ce1d734-673c-41c3-8b28-5bc20c657725","Type":"ContainerStarted","Data":"da0c90464cd65cd5a54c8c0f05c37db059b347233126ed1dd18109e959d7fc0e"} Sep 17 17:50:07.075494 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:07.075446 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:50:07.076822 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:07.076789 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-qjwmh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 17 17:50:07.076933 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:07.076850 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" podUID="0ce1d734-673c-41c3-8b28-5bc20c657725" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:50:07.115120 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:07.115072 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" podStartSLOduration=1.492077424 podStartE2EDuration="4.115054412s" totalImagesPullingTime="2.622976988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:50:07.114182459 +0000 UTC m=+536.958326488" watchObservedRunningTime="2026-09-17 17:50:07.115054412 +0000 UTC m=+536.959198442" Sep 17 17:50:08.081914 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:50:08.081885 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qjwmh" Sep 17 17:57:45.610647 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.610609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m"] Sep 17 17:57:45.614253 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.614231 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.618649 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.618627 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-gw-ca-root-cert\"" Sep 17 17:57:45.618783 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.618684 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"kube-root-ca.crt\"" Sep 17 17:57:45.619184 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.619165 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-service-ca.crt\"" Sep 17 17:57:45.619266 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.619224 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"router-gateway-1-openshift-default-dockercfg-mkk9f\"" Sep 17 17:57:45.641069 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.641043 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m"] Sep 17 17:57:45.779211 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779211 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779448 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779448 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779448 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779448 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779448 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779419 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779448 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.779677 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.779458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlltq\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-kube-api-access-jlltq\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880165 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880165 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880321 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880321 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880321 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlltq\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-kube-api-access-jlltq\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880321 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880321 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880573 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880573 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880684 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880590 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880744 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880708 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880786 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880738 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.880786 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.880748 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.881069 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.881049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.882696 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.882679 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.882744 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.882734 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.894704 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.894684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlltq\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-kube-api-access-jlltq\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.896863 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.896847 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-hw27m\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:45.924965 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:45.924942 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:57:46.206695 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:46.206671 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m"] Sep 17 17:57:46.208797 ip-10-0-142-71 kubenswrapper[2575]: W0917 17:57:46.208772 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6601e3_9fb1_4ab5_9cc6_794908036dff.slice/crio-95d52f4562991ae7826a805099e8bf256d8a0f2358ced700385c334383fe0e0d WatchSource:0}: Error finding container 95d52f4562991ae7826a805099e8bf256d8a0f2358ced700385c334383fe0e0d: Status 404 returned error can't find the container with id 95d52f4562991ae7826a805099e8bf256d8a0f2358ced700385c334383fe0e0d Sep 17 17:57:46.210644 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:46.210629 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:57:47.145646 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:47.145610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" event={"ID":"fc6601e3-9fb1-4ab5-9cc6-794908036dff","Type":"ContainerStarted","Data":"95d52f4562991ae7826a805099e8bf256d8a0f2358ced700385c334383fe0e0d"} Sep 17 17:57:59.605702 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:59.605666 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 17:57:59.605959 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:59.605740 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 17:57:59.605959 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:57:59.605783 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 17:58:00.212427 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:00.212392 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" event={"ID":"fc6601e3-9fb1-4ab5-9cc6-794908036dff","Type":"ContainerStarted","Data":"f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6"} Sep 17 17:58:00.235117 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:00.235063 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" podStartSLOduration=1.8403429679999999 podStartE2EDuration="15.235047917s" totalImagesPullingTime="13.394704949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:00.233565546 +0000 UTC m=+1010.077709574" watchObservedRunningTime="2026-09-17 17:58:00.235047917 +0000 UTC m=+1010.079191945" Sep 17 17:58:00.925596 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:00.925558 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:58:00.925992 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:00.925612 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:58:00.930756 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:00.930730 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:58:01.218462 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:01.218389 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:58:02.584028 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:02.583934 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m"] Sep 17 17:58:04.232756 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:04.232682 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" podUID="fc6601e3-9fb1-4ab5-9cc6-794908036dff" containerName="istio-proxy" containerID="cri-o://f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6" gracePeriod=30 Sep 17 17:58:09.485980 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.485953 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:58:09.587416 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587388 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-data\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587548 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587423 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istiod-ca-cert\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587548 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587460 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-credential-socket\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587548 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587484 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlltq\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-kube-api-access-jlltq\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587720 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587604 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-podinfo\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587720 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587649 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-envoy\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587720 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587673 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-certs\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587720 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587706 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-token\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587720 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587705 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:58:09.587977 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587735 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-socket\") pod \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\" (UID: \"fc6601e3-9fb1-4ab5-9cc6-794908036dff\") " Sep 17 17:58:09.587977 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587817 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:58:09.587977 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587860 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:58:09.587977 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.587936 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:58:09.588217 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.588115 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-data\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.588217 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.588138 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istiod-ca-cert\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.588217 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.588154 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-credential-socket\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.588217 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.588169 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.588217 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.588178 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:58:09.589783 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.589754 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 17 17:58:09.589885 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.589755 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-kube-api-access-jlltq" (OuterVolumeSpecName: "kube-api-access-jlltq") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "kube-api-access-jlltq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:58:09.589885 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.589815 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:58:09.589885 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.589833 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc6601e3-9fb1-4ab5-9cc6-794908036dff" (UID: "fc6601e3-9fb1-4ab5-9cc6-794908036dff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:58:09.689558 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.689525 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-token\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.689558 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.689559 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-workload-socket\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.689698 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.689568 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlltq\" (UniqueName: \"kubernetes.io/projected/fc6601e3-9fb1-4ab5-9cc6-794908036dff-kube-api-access-jlltq\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.689698 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.689577 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-podinfo\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:09.689698 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:09.689585 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6601e3-9fb1-4ab5-9cc6-794908036dff-istio-envoy\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 17:58:10.262605 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.262569 2575 generic.go:356] "Generic (PLEG): container finished" podID="fc6601e3-9fb1-4ab5-9cc6-794908036dff" containerID="f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6" exitCode=0 Sep 17 17:58:10.262784 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.262611 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" Sep 17 17:58:10.262784 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.262646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" event={"ID":"fc6601e3-9fb1-4ab5-9cc6-794908036dff","Type":"ContainerDied","Data":"f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6"} Sep 17 17:58:10.262784 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.262696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m" event={"ID":"fc6601e3-9fb1-4ab5-9cc6-794908036dff","Type":"ContainerDied","Data":"95d52f4562991ae7826a805099e8bf256d8a0f2358ced700385c334383fe0e0d"} Sep 17 17:58:10.262784 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.262722 2575 scope.go:117] "RemoveContainer" containerID="f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6" Sep 17 17:58:10.272365 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.272348 2575 scope.go:117] "RemoveContainer" containerID="f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6" Sep 17 17:58:10.272628 ip-10-0-142-71 kubenswrapper[2575]: E0917 17:58:10.272608 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6\": container with ID starting with f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6 not found: ID does not exist" containerID="f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6" Sep 17 17:58:10.272703 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.272642 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6"} err="failed to get container status \"f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6\": rpc error: code = NotFound desc = could not find container \"f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6\": container with ID starting with f2b1f066f7bbe5fa0cebd26a5b8dba8d8e5f10208768ce89a2480b9d946ca4e6 not found: ID does not exist" Sep 17 17:58:10.283549 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.283514 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m"] Sep 17 17:58:10.289162 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.289139 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-hw27m"] Sep 17 17:58:10.341454 ip-10-0-142-71 kubenswrapper[2575]: I0917 17:58:10.341415 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6601e3-9fb1-4ab5-9cc6-794908036dff" path="/var/lib/kubelet/pods/fc6601e3-9fb1-4ab5-9cc6-794908036dff/volumes" Sep 17 18:01:43.366718 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.366689 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92"] Sep 17 18:01:43.367168 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.367064 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc6601e3-9fb1-4ab5-9cc6-794908036dff" containerName="istio-proxy" Sep 17 18:01:43.367168 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.367077 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6601e3-9fb1-4ab5-9cc6-794908036dff" containerName="istio-proxy" Sep 17 18:01:43.367168 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.367130 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc6601e3-9fb1-4ab5-9cc6-794908036dff" containerName="istio-proxy" Sep 17 18:01:43.369135 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.369115 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.371753 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.371732 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"openshift-service-ca.crt\"" Sep 17 18:01:43.371753 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.371746 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"default-dockercfg-xflrk\"" Sep 17 18:01:43.371955 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.371734 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"kube-root-ca.crt\"" Sep 17 18:01:43.371955 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.371788 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-epp-sa-dockercfg-4q4m8\"" Sep 17 18:01:43.371955 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.371737 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-kserve-self-signed-certs\"" Sep 17 18:01:43.380266 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.380244 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92"] Sep 17 18:01:43.446531 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.446500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dnlx\" (UniqueName: \"kubernetes.io/projected/7feb3d14-d2f2-4907-9c82-dd45620313e1-kube-api-access-7dnlx\") pod \"auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.446646 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.446627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7feb3d14-d2f2-4907-9c82-dd45620313e1-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.547573 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.547539 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dnlx\" (UniqueName: \"kubernetes.io/projected/7feb3d14-d2f2-4907-9c82-dd45620313e1-kube-api-access-7dnlx\") pod \"auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.547573 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.547576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7feb3d14-d2f2-4907-9c82-dd45620313e1-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.550034 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.549999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7feb3d14-d2f2-4907-9c82-dd45620313e1-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.560335 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.560308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dnlx\" (UniqueName: \"kubernetes.io/projected/7feb3d14-d2f2-4907-9c82-dd45620313e1-kube-api-access-7dnlx\") pod \"auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.679431 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.679359 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:43.949725 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:43.949700 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92"] Sep 17 18:01:43.951824 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:01:43.951792 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7feb3d14_d2f2_4907_9c82_dd45620313e1.slice/crio-da60a57cdcad78ca9bf12f0ec1657d0ee62ae4fa6c9878933dc77a049ccceb82 WatchSource:0}: Error finding container da60a57cdcad78ca9bf12f0ec1657d0ee62ae4fa6c9878933dc77a049ccceb82: Status 404 returned error can't find the container with id da60a57cdcad78ca9bf12f0ec1657d0ee62ae4fa6c9878933dc77a049ccceb82 Sep 17 18:01:44.284785 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:44.284753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" event={"ID":"7feb3d14-d2f2-4907-9c82-dd45620313e1","Type":"ContainerStarted","Data":"da60a57cdcad78ca9bf12f0ec1657d0ee62ae4fa6c9878933dc77a049ccceb82"} Sep 17 18:01:47.301721 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:47.301687 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" event={"ID":"7feb3d14-d2f2-4907-9c82-dd45620313e1","Type":"ContainerStarted","Data":"d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd"} Sep 17 18:01:47.302103 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:47.301821 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:01:47.321050 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:01:47.320992 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" podStartSLOduration=1.982944568 podStartE2EDuration="4.320976909s" totalImagesPullingTime="2.338032341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:01:47.318879104 +0000 UTC m=+1237.163023134" watchObservedRunningTime="2026-09-17 18:01:47.320976909 +0000 UTC m=+1237.165120937" Sep 17 18:02:18.307879 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:02:18.307792 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:03:57.382538 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:03:57.382495 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92"] Sep 17 18:03:58.307840 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:03:58.307803 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:04:08.308077 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:08.308025 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:04:12.401946 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:12.401904 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" containerID="cri-o://d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd" gracePeriod=45 Sep 17 18:04:18.307556 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:18.307509 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:04:18.308064 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:18.307664 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:04:28.307559 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:28.307523 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:04:38.308140 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:38.308094 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:04:42.644198 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:42.644164 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:04:42.672757 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:42.672704 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dnlx\" (UniqueName: \"kubernetes.io/projected/7feb3d14-d2f2-4907-9c82-dd45620313e1-kube-api-access-7dnlx\") pod \"7feb3d14-d2f2-4907-9c82-dd45620313e1\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " Sep 17 18:04:42.672867 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:42.672813 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7feb3d14-d2f2-4907-9c82-dd45620313e1-tls-certs\") pod \"7feb3d14-d2f2-4907-9c82-dd45620313e1\" (UID: \"7feb3d14-d2f2-4907-9c82-dd45620313e1\") " Sep 17 18:04:42.674890 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:42.674863 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7feb3d14-d2f2-4907-9c82-dd45620313e1-kube-api-access-7dnlx" (OuterVolumeSpecName: "kube-api-access-7dnlx") pod "7feb3d14-d2f2-4907-9c82-dd45620313e1" (UID: "7feb3d14-d2f2-4907-9c82-dd45620313e1"). InnerVolumeSpecName "kube-api-access-7dnlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:04:42.674994 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:42.674888 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7feb3d14-d2f2-4907-9c82-dd45620313e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7feb3d14-d2f2-4907-9c82-dd45620313e1" (UID: "7feb3d14-d2f2-4907-9c82-dd45620313e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:04:42.774247 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:42.774215 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7feb3d14-d2f2-4907-9c82-dd45620313e1-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:04:42.774247 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:42.774239 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dnlx\" (UniqueName: \"kubernetes.io/projected/7feb3d14-d2f2-4907-9c82-dd45620313e1-kube-api-access-7dnlx\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:04:43.183749 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.183718 2575 generic.go:356] "Generic (PLEG): container finished" podID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerID="d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd" exitCode=0 Sep 17 18:04:43.183907 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.183768 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" Sep 17 18:04:43.183907 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.183773 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" event={"ID":"7feb3d14-d2f2-4907-9c82-dd45620313e1","Type":"ContainerDied","Data":"d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd"} Sep 17 18:04:43.183907 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.183893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92" event={"ID":"7feb3d14-d2f2-4907-9c82-dd45620313e1","Type":"ContainerDied","Data":"da60a57cdcad78ca9bf12f0ec1657d0ee62ae4fa6c9878933dc77a049ccceb82"} Sep 17 18:04:43.184123 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.183922 2575 scope.go:117] "RemoveContainer" containerID="d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd" Sep 17 18:04:43.193525 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.193506 2575 scope.go:117] "RemoveContainer" containerID="d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd" Sep 17 18:04:43.193849 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:04:43.193826 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd\": container with ID starting with d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd not found: ID does not exist" containerID="d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd" Sep 17 18:04:43.193956 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.193856 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd"} err="failed to get container status \"d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd\": rpc error: code = NotFound desc = could not find container \"d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd\": container with ID starting with d0c37fc78b200260ae38bb9f194999527380bea43559863c2bab9f124c29e7bd not found: ID does not exist" Sep 17 18:04:43.223822 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.223795 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92"] Sep 17 18:04:43.229825 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:04:43.229801 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7feb3d14_d2f2_4907_9c82_dd45620313e1.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7feb3d14_d2f2_4907_9c82_dd45620313e1.slice/crio-da60a57cdcad78ca9bf12f0ec1657d0ee62ae4fa6c9878933dc77a049ccceb82\": RecentStats: unable to find data in memory cache]" Sep 17 18:04:43.233396 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:43.233374 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6dc5d5cf9chqx92"] Sep 17 18:04:44.341397 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:04:44.341363 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" path="/var/lib/kubelet/pods/7feb3d14-d2f2-4907-9c82-dd45620313e1/volumes" Sep 17 18:05:39.364127 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.364094 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd"] Sep 17 18:05:39.364606 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.364591 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" Sep 17 18:05:39.364652 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.364608 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" Sep 17 18:05:39.364686 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.364675 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7feb3d14-d2f2-4907-9c82-dd45620313e1" containerName="main" Sep 17 18:05:39.366999 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.366974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.372475 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.372453 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"openshift-service-ca.crt\"" Sep 17 18:05:39.372644 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.372462 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-kserve-self-signed-certs\"" Sep 17 18:05:39.372644 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.372509 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-epp-sa-dockercfg-w6gqw\"" Sep 17 18:05:39.372644 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.372554 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"kube-root-ca.crt\"" Sep 17 18:05:39.372923 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.372902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"default-dockercfg-46sls\"" Sep 17 18:05:39.378657 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.378631 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd"] Sep 17 18:05:39.513414 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.513388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d188930a-f4fa-457a-82d8-21817e911c47-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.513530 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.513453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcggp\" (UniqueName: \"kubernetes.io/projected/d188930a-f4fa-457a-82d8-21817e911c47-kube-api-access-wcggp\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.614054 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.614004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcggp\" (UniqueName: \"kubernetes.io/projected/d188930a-f4fa-457a-82d8-21817e911c47-kube-api-access-wcggp\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.614208 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.614100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d188930a-f4fa-457a-82d8-21817e911c47-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.616575 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.616553 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d188930a-f4fa-457a-82d8-21817e911c47-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.622806 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.622782 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcggp\" (UniqueName: \"kubernetes.io/projected/d188930a-f4fa-457a-82d8-21817e911c47-kube-api-access-wcggp\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.678727 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.678706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:39.949960 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:39.949933 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd"] Sep 17 18:05:39.952578 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:05:39.952549 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd188930a_f4fa_457a_82d8_21817e911c47.slice/crio-bf1a6fb46b3d5cdcb2bacee9a26c97b084eb81e9ebb1eeb56f9cc4a7f3fb5c18 WatchSource:0}: Error finding container bf1a6fb46b3d5cdcb2bacee9a26c97b084eb81e9ebb1eeb56f9cc4a7f3fb5c18: Status 404 returned error can't find the container with id bf1a6fb46b3d5cdcb2bacee9a26c97b084eb81e9ebb1eeb56f9cc4a7f3fb5c18 Sep 17 18:05:40.465410 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:40.465376 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" event={"ID":"d188930a-f4fa-457a-82d8-21817e911c47","Type":"ContainerStarted","Data":"a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3"} Sep 17 18:05:40.465783 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:40.465436 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" event={"ID":"d188930a-f4fa-457a-82d8-21817e911c47","Type":"ContainerStarted","Data":"bf1a6fb46b3d5cdcb2bacee9a26c97b084eb81e9ebb1eeb56f9cc4a7f3fb5c18"} Sep 17 18:05:40.465783 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:40.465540 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:05:40.495918 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:05:40.495872 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" podStartSLOduration=1.495856874 podStartE2EDuration="1.495856874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:05:40.493108582 +0000 UTC m=+1470.337252624" watchObservedRunningTime="2026-09-17 18:05:40.495856874 +0000 UTC m=+1470.340000903" Sep 17 18:06:11.473301 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:11.473270 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:06:17.455954 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:17.455917 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd"] Sep 17 18:06:21.474029 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:21.473975 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:06:31.473124 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:31.473032 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:06:32.475463 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:32.475422 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" containerID="cri-o://a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3" gracePeriod=45 Sep 17 18:06:41.473439 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:41.473397 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:06:41.473834 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:41.473529 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:06:51.474130 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:06:51.474081 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:07:01.474144 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:01.474093 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:07:02.715392 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.715366 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:07:02.781847 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.781826 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d188930a-f4fa-457a-82d8-21817e911c47-tls-certs\") pod \"d188930a-f4fa-457a-82d8-21817e911c47\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " Sep 17 18:07:02.781954 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.781861 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcggp\" (UniqueName: \"kubernetes.io/projected/d188930a-f4fa-457a-82d8-21817e911c47-kube-api-access-wcggp\") pod \"d188930a-f4fa-457a-82d8-21817e911c47\" (UID: \"d188930a-f4fa-457a-82d8-21817e911c47\") " Sep 17 18:07:02.783899 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.783864 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d188930a-f4fa-457a-82d8-21817e911c47-kube-api-access-wcggp" (OuterVolumeSpecName: "kube-api-access-wcggp") pod "d188930a-f4fa-457a-82d8-21817e911c47" (UID: "d188930a-f4fa-457a-82d8-21817e911c47"). InnerVolumeSpecName "kube-api-access-wcggp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:07:02.783989 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.783947 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d188930a-f4fa-457a-82d8-21817e911c47-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d188930a-f4fa-457a-82d8-21817e911c47" (UID: "d188930a-f4fa-457a-82d8-21817e911c47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:07:02.870157 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.870131 2575 generic.go:356] "Generic (PLEG): container finished" podID="d188930a-f4fa-457a-82d8-21817e911c47" containerID="a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3" exitCode=0 Sep 17 18:07:02.870254 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.870168 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" Sep 17 18:07:02.870254 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.870176 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" event={"ID":"d188930a-f4fa-457a-82d8-21817e911c47","Type":"ContainerDied","Data":"a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3"} Sep 17 18:07:02.870254 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.870218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd" event={"ID":"d188930a-f4fa-457a-82d8-21817e911c47","Type":"ContainerDied","Data":"bf1a6fb46b3d5cdcb2bacee9a26c97b084eb81e9ebb1eeb56f9cc4a7f3fb5c18"} Sep 17 18:07:02.870254 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.870241 2575 scope.go:117] "RemoveContainer" containerID="a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3" Sep 17 18:07:02.878953 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.878934 2575 scope.go:117] "RemoveContainer" containerID="a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3" Sep 17 18:07:02.879216 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:07:02.879196 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3\": container with ID starting with a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3 not found: ID does not exist" containerID="a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3" Sep 17 18:07:02.879286 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.879222 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3"} err="failed to get container status \"a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3\": rpc error: code = NotFound desc = could not find container \"a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3\": container with ID starting with a2ce645dd30939354eab4384e97730c5692c557287045d156549bfa5b5e959a3 not found: ID does not exist" Sep 17 18:07:02.882675 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.882653 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d188930a-f4fa-457a-82d8-21817e911c47-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:07:02.882734 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.882678 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcggp\" (UniqueName: \"kubernetes.io/projected/d188930a-f4fa-457a-82d8-21817e911c47-kube-api-access-wcggp\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:07:02.892774 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.892750 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd"] Sep 17 18:07:02.895572 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:02.895553 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d5ftmd"] Sep 17 18:07:04.341881 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:04.341845 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d188930a-f4fa-457a-82d8-21817e911c47" path="/var/lib/kubelet/pods/d188930a-f4fa-457a-82d8-21817e911c47/volumes" Sep 17 18:07:17.078971 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.078940 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k"] Sep 17 18:07:17.079343 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.079309 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" Sep 17 18:07:17.079343 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.079321 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" Sep 17 18:07:17.079427 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.079385 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d188930a-f4fa-457a-82d8-21817e911c47" containerName="main" Sep 17 18:07:17.083641 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.083622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.086960 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.086943 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"openshift-service-ca.crt\"" Sep 17 18:07:17.087075 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.086970 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"default-dockercfg-b9848\"" Sep 17 18:07:17.087582 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.087563 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"kube-root-ca.crt\"" Sep 17 18:07:17.087681 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.087583 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-4qxxw\"" Sep 17 18:07:17.087735 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.087711 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\"" Sep 17 18:07:17.097542 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.097521 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k"] Sep 17 18:07:17.194191 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.194162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjqnr\" (UniqueName: \"kubernetes.io/projected/c488d1d8-414f-436a-9037-17f5bef347f2-kube-api-access-hjqnr\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.194303 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.194227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c488d1d8-414f-436a-9037-17f5bef347f2-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.295261 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.295233 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjqnr\" (UniqueName: \"kubernetes.io/projected/c488d1d8-414f-436a-9037-17f5bef347f2-kube-api-access-hjqnr\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.295384 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.295269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c488d1d8-414f-436a-9037-17f5bef347f2-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.297639 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.297621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c488d1d8-414f-436a-9037-17f5bef347f2-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.314020 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.313991 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjqnr\" (UniqueName: \"kubernetes.io/projected/c488d1d8-414f-436a-9037-17f5bef347f2-kube-api-access-hjqnr\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.394256 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.394203 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.679904 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.679877 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k"] Sep 17 18:07:17.681853 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:07:17.681819 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc488d1d8_414f_436a_9037_17f5bef347f2.slice/crio-f3b4c10ef52ee6ec97fc0f82519b94a71e2c7a8e9dece97ab42247af8f2b4a7c WatchSource:0}: Error finding container f3b4c10ef52ee6ec97fc0f82519b94a71e2c7a8e9dece97ab42247af8f2b4a7c: Status 404 returned error can't find the container with id f3b4c10ef52ee6ec97fc0f82519b94a71e2c7a8e9dece97ab42247af8f2b4a7c Sep 17 18:07:17.947700 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.947619 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" event={"ID":"c488d1d8-414f-436a-9037-17f5bef347f2","Type":"ContainerStarted","Data":"e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec"} Sep 17 18:07:17.947700 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.947671 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" event={"ID":"c488d1d8-414f-436a-9037-17f5bef347f2","Type":"ContainerStarted","Data":"f3b4c10ef52ee6ec97fc0f82519b94a71e2c7a8e9dece97ab42247af8f2b4a7c"} Sep 17 18:07:17.947700 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.947695 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:17.969654 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:17.969608 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" podStartSLOduration=0.969594375 podStartE2EDuration="969.594375ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:07:17.967585873 +0000 UTC m=+1567.811729903" watchObservedRunningTime="2026-09-17 18:07:17.969594375 +0000 UTC m=+1567.813738404" Sep 17 18:07:48.954589 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:48.954552 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:07:50.271442 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:50.271408 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k"] Sep 17 18:07:58.954349 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:07:58.954251 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:08:05.290631 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:05.290582 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" containerID="cri-o://e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec" gracePeriod=45 Sep 17 18:08:08.954273 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:08.954233 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:08:18.953544 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:18.953494 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:08:18.954061 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:18.953620 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:08:28.954284 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:28.954241 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:08:35.530635 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:35.530608 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:08:35.616757 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:35.616696 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c488d1d8-414f-436a-9037-17f5bef347f2-tls-certs\") pod \"c488d1d8-414f-436a-9037-17f5bef347f2\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " Sep 17 18:08:35.616757 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:35.616755 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjqnr\" (UniqueName: \"kubernetes.io/projected/c488d1d8-414f-436a-9037-17f5bef347f2-kube-api-access-hjqnr\") pod \"c488d1d8-414f-436a-9037-17f5bef347f2\" (UID: \"c488d1d8-414f-436a-9037-17f5bef347f2\") " Sep 17 18:08:35.618867 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:35.618843 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c488d1d8-414f-436a-9037-17f5bef347f2-kube-api-access-hjqnr" (OuterVolumeSpecName: "kube-api-access-hjqnr") pod "c488d1d8-414f-436a-9037-17f5bef347f2" (UID: "c488d1d8-414f-436a-9037-17f5bef347f2"). InnerVolumeSpecName "kube-api-access-hjqnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:08:35.618962 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:35.618870 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c488d1d8-414f-436a-9037-17f5bef347f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c488d1d8-414f-436a-9037-17f5bef347f2" (UID: "c488d1d8-414f-436a-9037-17f5bef347f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:08:35.717747 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:35.717726 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c488d1d8-414f-436a-9037-17f5bef347f2-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:08:35.717747 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:35.717746 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjqnr\" (UniqueName: \"kubernetes.io/projected/c488d1d8-414f-436a-9037-17f5bef347f2-kube-api-access-hjqnr\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:08:36.347295 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.347253 2575 generic.go:356] "Generic (PLEG): container finished" podID="c488d1d8-414f-436a-9037-17f5bef347f2" containerID="e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec" exitCode=0 Sep 17 18:08:36.347489 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.347393 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" Sep 17 18:08:36.348978 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.348945 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" event={"ID":"c488d1d8-414f-436a-9037-17f5bef347f2","Type":"ContainerDied","Data":"e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec"} Sep 17 18:08:36.349120 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.349024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k" event={"ID":"c488d1d8-414f-436a-9037-17f5bef347f2","Type":"ContainerDied","Data":"f3b4c10ef52ee6ec97fc0f82519b94a71e2c7a8e9dece97ab42247af8f2b4a7c"} Sep 17 18:08:36.349120 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.349062 2575 scope.go:117] "RemoveContainer" containerID="e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec" Sep 17 18:08:36.358484 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.358464 2575 scope.go:117] "RemoveContainer" containerID="e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec" Sep 17 18:08:36.358839 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:08:36.358818 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec\": container with ID starting with e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec not found: ID does not exist" containerID="e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec" Sep 17 18:08:36.358938 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.358851 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec"} err="failed to get container status \"e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec\": rpc error: code = NotFound desc = could not find container \"e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec\": container with ID starting with e2f62bdfc8ca6d04655b2537170a2d5cbb9fe54dfd78c0a653650f0ae32babec not found: ID does not exist" Sep 17 18:08:36.371900 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.371870 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k"] Sep 17 18:08:36.375890 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:36.375869 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schesb49k"] Sep 17 18:08:38.341817 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:08:38.341778 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" path="/var/lib/kubelet/pods/c488d1d8-414f-436a-9037-17f5bef347f2/volumes" Sep 17 18:09:45.498085 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.497977 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47"] Sep 17 18:09:45.498696 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.498402 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" Sep 17 18:09:45.498696 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.498416 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" Sep 17 18:09:45.498696 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.498507 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c488d1d8-414f-436a-9037-17f5bef347f2" containerName="main" Sep 17 18:09:45.501571 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.501548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:45.504246 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.504213 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-zqr5c\"" Sep 17 18:09:45.504372 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.504253 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\"" Sep 17 18:09:45.504372 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.504213 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\"" Sep 17 18:09:45.504372 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.504307 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-dlhsf\"" Sep 17 18:09:45.504743 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.504694 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\"" Sep 17 18:09:45.512484 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.512463 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47"] Sep 17 18:09:45.674492 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.674469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2db844b-d4da-4f50-a330-da7b262ff038-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:45.674613 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.674545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx499\" (UniqueName: \"kubernetes.io/projected/f2db844b-d4da-4f50-a330-da7b262ff038-kube-api-access-vx499\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:45.775806 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.775781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx499\" (UniqueName: \"kubernetes.io/projected/f2db844b-d4da-4f50-a330-da7b262ff038-kube-api-access-vx499\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:45.775911 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.775832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2db844b-d4da-4f50-a330-da7b262ff038-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:45.778463 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.778441 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2db844b-d4da-4f50-a330-da7b262ff038-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:45.783167 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.783141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx499\" (UniqueName: \"kubernetes.io/projected/f2db844b-d4da-4f50-a330-da7b262ff038-kube-api-access-vx499\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:45.813661 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:45.813639 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:46.086554 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:46.086515 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47"] Sep 17 18:09:46.088266 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:09:46.088240 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2db844b_d4da_4f50_a330_da7b262ff038.slice/crio-03d63e5f3756f8bcdef4a5b0616a075bea6f8f23e877972562c5b2e03e2b6b10 WatchSource:0}: Error finding container 03d63e5f3756f8bcdef4a5b0616a075bea6f8f23e877972562c5b2e03e2b6b10: Status 404 returned error can't find the container with id 03d63e5f3756f8bcdef4a5b0616a075bea6f8f23e877972562c5b2e03e2b6b10 Sep 17 18:09:46.691561 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:46.691528 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" event={"ID":"f2db844b-d4da-4f50-a330-da7b262ff038","Type":"ContainerStarted","Data":"fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691"} Sep 17 18:09:46.691940 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:46.691583 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" event={"ID":"f2db844b-d4da-4f50-a330-da7b262ff038","Type":"ContainerStarted","Data":"03d63e5f3756f8bcdef4a5b0616a075bea6f8f23e877972562c5b2e03e2b6b10"} Sep 17 18:09:46.691940 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:46.691624 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:09:46.710651 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:09:46.710605 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" podStartSLOduration=1.710588966 podStartE2EDuration="1.710588966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:09:46.710108098 +0000 UTC m=+1716.554252127" watchObservedRunningTime="2026-09-17 18:09:46.710588966 +0000 UTC m=+1716.554732995" Sep 17 18:10:17.701966 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:17.701941 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:10:23.841350 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:23.841316 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47"] Sep 17 18:10:27.702806 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:27.702762 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:10:37.702249 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:37.702207 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:10:38.860961 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:38.860913 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" containerID="cri-o://fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691" gracePeriod=45 Sep 17 18:10:47.702616 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:47.702575 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:10:47.703183 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:47.702679 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:10:57.702763 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:10:57.702682 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:11:07.702186 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:07.702143 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:11:09.105403 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.105380 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:11:09.110377 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.110352 2575 generic.go:356] "Generic (PLEG): container finished" podID="f2db844b-d4da-4f50-a330-da7b262ff038" containerID="fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691" exitCode=0 Sep 17 18:11:09.110489 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.110393 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" Sep 17 18:11:09.110489 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.110404 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" event={"ID":"f2db844b-d4da-4f50-a330-da7b262ff038","Type":"ContainerDied","Data":"fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691"} Sep 17 18:11:09.110489 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.110443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47" event={"ID":"f2db844b-d4da-4f50-a330-da7b262ff038","Type":"ContainerDied","Data":"03d63e5f3756f8bcdef4a5b0616a075bea6f8f23e877972562c5b2e03e2b6b10"} Sep 17 18:11:09.110489 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.110465 2575 scope.go:117] "RemoveContainer" containerID="fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691" Sep 17 18:11:09.118489 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.118473 2575 scope.go:117] "RemoveContainer" containerID="fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691" Sep 17 18:11:09.118774 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:11:09.118748 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691\": container with ID starting with fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691 not found: ID does not exist" containerID="fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691" Sep 17 18:11:09.118823 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.118784 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691"} err="failed to get container status \"fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691\": rpc error: code = NotFound desc = could not find container \"fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691\": container with ID starting with fb0d672e5ee3a2e253e468e28cc890aa31d8a06d1d8651de7d32e9a0bc108691 not found: ID does not exist" Sep 17 18:11:09.144070 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.144043 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2db844b-d4da-4f50-a330-da7b262ff038-tls-certs\") pod \"f2db844b-d4da-4f50-a330-da7b262ff038\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " Sep 17 18:11:09.144159 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.144128 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx499\" (UniqueName: \"kubernetes.io/projected/f2db844b-d4da-4f50-a330-da7b262ff038-kube-api-access-vx499\") pod \"f2db844b-d4da-4f50-a330-da7b262ff038\" (UID: \"f2db844b-d4da-4f50-a330-da7b262ff038\") " Sep 17 18:11:09.146145 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.146117 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2db844b-d4da-4f50-a330-da7b262ff038-kube-api-access-vx499" (OuterVolumeSpecName: "kube-api-access-vx499") pod "f2db844b-d4da-4f50-a330-da7b262ff038" (UID: "f2db844b-d4da-4f50-a330-da7b262ff038"). InnerVolumeSpecName "kube-api-access-vx499". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:11:09.146224 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.146153 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2db844b-d4da-4f50-a330-da7b262ff038-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f2db844b-d4da-4f50-a330-da7b262ff038" (UID: "f2db844b-d4da-4f50-a330-da7b262ff038"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:11:09.245437 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.245414 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2db844b-d4da-4f50-a330-da7b262ff038-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:11:09.245437 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.245436 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx499\" (UniqueName: \"kubernetes.io/projected/f2db844b-d4da-4f50-a330-da7b262ff038-kube-api-access-vx499\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:11:09.436903 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.436872 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47"] Sep 17 18:11:09.442494 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:09.442474 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schel6p47"] Sep 17 18:11:10.342134 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:11:10.342100 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" path="/var/lib/kubelet/pods/f2db844b-d4da-4f50-a330-da7b262ff038/volumes" Sep 17 18:14:11.405901 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.405812 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch"] Sep 17 18:14:11.406470 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.406217 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" Sep 17 18:14:11.406470 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.406230 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" Sep 17 18:14:11.406470 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.406294 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2db844b-d4da-4f50-a330-da7b262ff038" containerName="main" Sep 17 18:14:11.409307 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.409283 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.412140 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.412116 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-qtjmg\"" Sep 17 18:14:11.412252 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.412153 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\"" Sep 17 18:14:11.412252 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.412163 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\"" Sep 17 18:14:11.412252 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.412182 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-btnfq\"" Sep 17 18:14:11.412396 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.412250 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\"" Sep 17 18:14:11.418037 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.417998 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch"] Sep 17 18:14:11.496059 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.496038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f7998e-4683-4374-98b2-3868ae8418b6-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.496175 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.496085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2h7x\" (UniqueName: \"kubernetes.io/projected/59f7998e-4683-4374-98b2-3868ae8418b6-kube-api-access-n2h7x\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.596570 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.596547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f7998e-4683-4374-98b2-3868ae8418b6-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.596660 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.596596 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2h7x\" (UniqueName: \"kubernetes.io/projected/59f7998e-4683-4374-98b2-3868ae8418b6-kube-api-access-n2h7x\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.599031 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.598987 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f7998e-4683-4374-98b2-3868ae8418b6-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.604208 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.604185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2h7x\" (UniqueName: \"kubernetes.io/projected/59f7998e-4683-4374-98b2-3868ae8418b6-kube-api-access-n2h7x\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.721102 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.721041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:11.988796 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:11.988727 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch"] Sep 17 18:14:11.991706 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:14:11.991681 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f7998e_4683_4374_98b2_3868ae8418b6.slice/crio-692f7fa33f6c45bb71a2327d4844bb8cb00616f79a2f7b4125b37ac2281155d4 WatchSource:0}: Error finding container 692f7fa33f6c45bb71a2327d4844bb8cb00616f79a2f7b4125b37ac2281155d4: Status 404 returned error can't find the container with id 692f7fa33f6c45bb71a2327d4844bb8cb00616f79a2f7b4125b37ac2281155d4 Sep 17 18:14:12.030591 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:12.030558 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" event={"ID":"59f7998e-4683-4374-98b2-3868ae8418b6","Type":"ContainerStarted","Data":"692f7fa33f6c45bb71a2327d4844bb8cb00616f79a2f7b4125b37ac2281155d4"} Sep 17 18:14:13.036839 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:13.036801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" event={"ID":"59f7998e-4683-4374-98b2-3868ae8418b6","Type":"ContainerStarted","Data":"a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574"} Sep 17 18:14:13.037257 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:13.036918 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:13.056427 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:13.056379 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" podStartSLOduration=2.056364438 podStartE2EDuration="2.056364438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:13.054978099 +0000 UTC m=+1982.899122128" watchObservedRunningTime="2026-09-17 18:14:13.056364438 +0000 UTC m=+1982.900508467" Sep 17 18:14:44.042775 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:44.042747 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:14:45.356647 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:45.356612 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch"] Sep 17 18:14:54.042858 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:14:54.042814 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:15:00.378620 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:00.378569 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" containerID="cri-o://a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574" gracePeriod=45 Sep 17 18:15:04.043739 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:04.043691 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:15:14.042962 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:14.042926 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:15:14.043370 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:14.043065 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:15:24.043395 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:24.043295 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:15:30.627048 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:30.627025 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:15:30.706748 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:30.706683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2h7x\" (UniqueName: \"kubernetes.io/projected/59f7998e-4683-4374-98b2-3868ae8418b6-kube-api-access-n2h7x\") pod \"59f7998e-4683-4374-98b2-3868ae8418b6\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " Sep 17 18:15:30.706864 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:30.706765 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f7998e-4683-4374-98b2-3868ae8418b6-tls-certs\") pod \"59f7998e-4683-4374-98b2-3868ae8418b6\" (UID: \"59f7998e-4683-4374-98b2-3868ae8418b6\") " Sep 17 18:15:30.708811 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:30.708783 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f7998e-4683-4374-98b2-3868ae8418b6-kube-api-access-n2h7x" (OuterVolumeSpecName: "kube-api-access-n2h7x") pod "59f7998e-4683-4374-98b2-3868ae8418b6" (UID: "59f7998e-4683-4374-98b2-3868ae8418b6"). InnerVolumeSpecName "kube-api-access-n2h7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:15:30.708902 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:30.708874 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f7998e-4683-4374-98b2-3868ae8418b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "59f7998e-4683-4374-98b2-3868ae8418b6" (UID: "59f7998e-4683-4374-98b2-3868ae8418b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:30.807324 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:30.807299 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2h7x\" (UniqueName: \"kubernetes.io/projected/59f7998e-4683-4374-98b2-3868ae8418b6-kube-api-access-n2h7x\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:15:30.807324 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:30.807322 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f7998e-4683-4374-98b2-3868ae8418b6-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:15:31.428593 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.428559 2575 generic.go:356] "Generic (PLEG): container finished" podID="59f7998e-4683-4374-98b2-3868ae8418b6" containerID="a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574" exitCode=0 Sep 17 18:15:31.428786 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.428612 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" Sep 17 18:15:31.428786 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.428612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" event={"ID":"59f7998e-4683-4374-98b2-3868ae8418b6","Type":"ContainerDied","Data":"a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574"} Sep 17 18:15:31.428786 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.428739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch" event={"ID":"59f7998e-4683-4374-98b2-3868ae8418b6","Type":"ContainerDied","Data":"692f7fa33f6c45bb71a2327d4844bb8cb00616f79a2f7b4125b37ac2281155d4"} Sep 17 18:15:31.428786 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.428773 2575 scope.go:117] "RemoveContainer" containerID="a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574" Sep 17 18:15:31.438826 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.438807 2575 scope.go:117] "RemoveContainer" containerID="a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574" Sep 17 18:15:31.439165 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:15:31.439138 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574\": container with ID starting with a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574 not found: ID does not exist" containerID="a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574" Sep 17 18:15:31.439227 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.439175 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574"} err="failed to get container status \"a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574\": rpc error: code = NotFound desc = could not find container \"a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574\": container with ID starting with a28347eb01afc86281ef88aa0e93eb42edc5435bf9c3584e7a68798099e70574 not found: ID does not exist" Sep 17 18:15:31.450525 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.450502 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch"] Sep 17 18:15:31.454603 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:31.454582 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche5p2ch"] Sep 17 18:15:32.342491 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:15:32.342459 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" path="/var/lib/kubelet/pods/59f7998e-4683-4374-98b2-3868ae8418b6/volumes" Sep 17 18:16:28.071759 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.071724 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf"] Sep 17 18:16:28.072311 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.072104 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" Sep 17 18:16:28.072311 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.072116 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" Sep 17 18:16:28.072311 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.072179 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f7998e-4683-4374-98b2-3868ae8418b6" containerName="main" Sep 17 18:16:28.084320 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.084295 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf"] Sep 17 18:16:28.084480 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.084389 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.086763 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.086731 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"kube-root-ca.crt\"" Sep 17 18:16:28.087663 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.087313 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"default-dockercfg-fn5bf\"" Sep 17 18:16:28.087663 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.087380 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"openshift-service-ca.crt\"" Sep 17 18:16:28.087663 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.087493 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\"" Sep 17 18:16:28.087663 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.087555 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-xn4cs\"" Sep 17 18:16:28.164831 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.164806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4070dfeb-ff09-4bb6-92d6-4658df866b7e-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.164986 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.164850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4kt\" (UniqueName: \"kubernetes.io/projected/4070dfeb-ff09-4bb6-92d6-4658df866b7e-kube-api-access-fb4kt\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.266086 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.266054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4070dfeb-ff09-4bb6-92d6-4658df866b7e-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.266205 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.266117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kt\" (UniqueName: \"kubernetes.io/projected/4070dfeb-ff09-4bb6-92d6-4658df866b7e-kube-api-access-fb4kt\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.268465 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.268438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4070dfeb-ff09-4bb6-92d6-4658df866b7e-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.273138 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.273116 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4kt\" (UniqueName: \"kubernetes.io/projected/4070dfeb-ff09-4bb6-92d6-4658df866b7e-kube-api-access-fb4kt\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.398036 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.397956 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:28.680389 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.680366 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf"] Sep 17 18:16:28.686194 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:16:28.686150 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4070dfeb_ff09_4bb6_92d6_4658df866b7e.slice/crio-5f2159654bd81a0efc4219726c9f628e9a29b4fc93f96b879ba4161652d733cd WatchSource:0}: Error finding container 5f2159654bd81a0efc4219726c9f628e9a29b4fc93f96b879ba4161652d733cd: Status 404 returned error can't find the container with id 5f2159654bd81a0efc4219726c9f628e9a29b4fc93f96b879ba4161652d733cd Sep 17 18:16:28.722379 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:28.722352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" event={"ID":"4070dfeb-ff09-4bb6-92d6-4658df866b7e","Type":"ContainerStarted","Data":"5f2159654bd81a0efc4219726c9f628e9a29b4fc93f96b879ba4161652d733cd"} Sep 17 18:16:29.729454 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:29.729410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" event={"ID":"4070dfeb-ff09-4bb6-92d6-4658df866b7e","Type":"ContainerStarted","Data":"f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9"} Sep 17 18:16:29.729846 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:29.729495 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:16:29.747023 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:16:29.746960 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" podStartSLOduration=1.746944592 podStartE2EDuration="1.746944592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:16:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:16:29.745220204 +0000 UTC m=+2119.589364234" watchObservedRunningTime="2026-09-17 18:16:29.746944592 +0000 UTC m=+2119.591088655" Sep 17 18:17:00.736757 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:17:00.736667 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:18:23.703377 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:18:23.703301 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf"] Sep 17 18:18:30.736797 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:18:30.736748 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:18:38.724361 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:18:38.724291 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" containerID="cri-o://f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9" gracePeriod=45 Sep 17 18:18:40.736812 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:18:40.736769 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:18:50.736551 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:18:50.736515 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:18:50.736985 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:18:50.736636 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:19:00.736398 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:00.736353 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:19:08.966684 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:08.966661 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:19:09.115496 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.115464 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4070dfeb-ff09-4bb6-92d6-4658df866b7e-tls-certs\") pod \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " Sep 17 18:19:09.115651 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.115541 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb4kt\" (UniqueName: \"kubernetes.io/projected/4070dfeb-ff09-4bb6-92d6-4658df866b7e-kube-api-access-fb4kt\") pod \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\" (UID: \"4070dfeb-ff09-4bb6-92d6-4658df866b7e\") " Sep 17 18:19:09.117744 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.117718 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4070dfeb-ff09-4bb6-92d6-4658df866b7e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4070dfeb-ff09-4bb6-92d6-4658df866b7e" (UID: "4070dfeb-ff09-4bb6-92d6-4658df866b7e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:19:09.117849 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.117824 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4070dfeb-ff09-4bb6-92d6-4658df866b7e-kube-api-access-fb4kt" (OuterVolumeSpecName: "kube-api-access-fb4kt") pod "4070dfeb-ff09-4bb6-92d6-4658df866b7e" (UID: "4070dfeb-ff09-4bb6-92d6-4658df866b7e"). InnerVolumeSpecName "kube-api-access-fb4kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:19:09.216749 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.216717 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4070dfeb-ff09-4bb6-92d6-4658df866b7e-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:19:09.216749 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.216748 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb4kt\" (UniqueName: \"kubernetes.io/projected/4070dfeb-ff09-4bb6-92d6-4658df866b7e-kube-api-access-fb4kt\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:19:09.559208 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.559174 2575 generic.go:356] "Generic (PLEG): container finished" podID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerID="f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9" exitCode=0 Sep 17 18:19:09.559340 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.559218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" event={"ID":"4070dfeb-ff09-4bb6-92d6-4658df866b7e","Type":"ContainerDied","Data":"f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9"} Sep 17 18:19:09.559340 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.559230 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" Sep 17 18:19:09.559340 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.559300 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf" event={"ID":"4070dfeb-ff09-4bb6-92d6-4658df866b7e","Type":"ContainerDied","Data":"5f2159654bd81a0efc4219726c9f628e9a29b4fc93f96b879ba4161652d733cd"} Sep 17 18:19:09.559340 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.559330 2575 scope.go:117] "RemoveContainer" containerID="f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9" Sep 17 18:19:09.569235 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.569209 2575 scope.go:117] "RemoveContainer" containerID="f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9" Sep 17 18:19:09.569537 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:19:09.569517 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9\": container with ID starting with f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9 not found: ID does not exist" containerID="f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9" Sep 17 18:19:09.569586 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.569546 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9"} err="failed to get container status \"f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9\": rpc error: code = NotFound desc = could not find container \"f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9\": container with ID starting with f3da10f3cc283e626ff5b24c543d194104f8abb18408b06e1292a5c5d1ec40d9 not found: ID does not exist" Sep 17 18:19:09.578725 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.578694 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf"] Sep 17 18:19:09.582584 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:09.582559 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schejsztf"] Sep 17 18:19:10.341891 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:19:10.341856 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" path="/var/lib/kubelet/pods/4070dfeb-ff09-4bb6-92d6-4658df866b7e/volumes" Sep 17 18:20:06.161871 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.161782 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4"] Sep 17 18:20:06.162458 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.162434 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" Sep 17 18:20:06.162458 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.162457 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" Sep 17 18:20:06.162635 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.162589 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4070dfeb-ff09-4bb6-92d6-4658df866b7e" containerName="main" Sep 17 18:20:06.165870 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.165852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.170615 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.170592 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-epp-sa-dockercfg-dv4cb\"" Sep 17 18:20:06.170729 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.170637 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"openshift-service-ca.crt\"" Sep 17 18:20:06.170729 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.170690 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"default-dockercfg-xdp4t\"" Sep 17 18:20:06.170835 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.170635 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"kube-root-ca.crt\"" Sep 17 18:20:06.170893 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.170877 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-kserve-self-signed-certs\"" Sep 17 18:20:06.175552 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.175531 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4"] Sep 17 18:20:06.259583 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.259559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f3a337-2118-4828-be24-022b15662a80-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.259675 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.259629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zbx\" (UniqueName: \"kubernetes.io/projected/c3f3a337-2118-4828-be24-022b15662a80-kube-api-access-c8zbx\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.360884 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.360861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zbx\" (UniqueName: \"kubernetes.io/projected/c3f3a337-2118-4828-be24-022b15662a80-kube-api-access-c8zbx\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.360983 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.360916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f3a337-2118-4828-be24-022b15662a80-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.363349 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.363329 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f3a337-2118-4828-be24-022b15662a80-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.368516 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.368496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zbx\" (UniqueName: \"kubernetes.io/projected/c3f3a337-2118-4828-be24-022b15662a80-kube-api-access-c8zbx\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.477726 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.477676 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.749439 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.749416 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4"] Sep 17 18:20:06.752205 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:20:06.752177 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f3a337_2118_4828_be24_022b15662a80.slice/crio-b7e06fe45bc539e1d052ac969b494254eeca39b17cc3e9d1dc2f3ce06e902a89 WatchSource:0}: Error finding container b7e06fe45bc539e1d052ac969b494254eeca39b17cc3e9d1dc2f3ce06e902a89: Status 404 returned error can't find the container with id b7e06fe45bc539e1d052ac969b494254eeca39b17cc3e9d1dc2f3ce06e902a89 Sep 17 18:20:06.863138 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.863096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" event={"ID":"c3f3a337-2118-4828-be24-022b15662a80","Type":"ContainerStarted","Data":"5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b"} Sep 17 18:20:06.863307 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.863162 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" event={"ID":"c3f3a337-2118-4828-be24-022b15662a80","Type":"ContainerStarted","Data":"b7e06fe45bc539e1d052ac969b494254eeca39b17cc3e9d1dc2f3ce06e902a89"} Sep 17 18:20:06.863307 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.863195 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:20:06.879176 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:06.879132 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" podStartSLOduration=0.879117517 podStartE2EDuration="879.117517ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:20:06.877805623 +0000 UTC m=+2336.721949651" watchObservedRunningTime="2026-09-17 18:20:06.879117517 +0000 UTC m=+2336.723261545" Sep 17 18:20:37.870736 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:20:37.870706 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:22:33.063639 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:22:33.063583 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4"] Sep 17 18:22:37.871451 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:22:37.871385 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:22:47.870946 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:22:47.870881 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:22:48.089122 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:22:48.089058 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" containerID="cri-o://5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b" gracePeriod=45 Sep 17 18:22:57.872001 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:22:57.871878 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:22:57.872617 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:22:57.872133 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:23:07.871320 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:07.871253 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:23:17.870938 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:17.870885 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:23:18.372261 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.372226 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:23:18.448928 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.448855 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f3a337-2118-4828-be24-022b15662a80-tls-certs\") pod \"c3f3a337-2118-4828-be24-022b15662a80\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " Sep 17 18:23:18.449286 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.449062 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8zbx\" (UniqueName: \"kubernetes.io/projected/c3f3a337-2118-4828-be24-022b15662a80-kube-api-access-c8zbx\") pod \"c3f3a337-2118-4828-be24-022b15662a80\" (UID: \"c3f3a337-2118-4828-be24-022b15662a80\") " Sep 17 18:23:18.451976 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.451927 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f3a337-2118-4828-be24-022b15662a80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3f3a337-2118-4828-be24-022b15662a80" (UID: "c3f3a337-2118-4828-be24-022b15662a80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:23:18.451976 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.451940 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f3a337-2118-4828-be24-022b15662a80-kube-api-access-c8zbx" (OuterVolumeSpecName: "kube-api-access-c8zbx") pod "c3f3a337-2118-4828-be24-022b15662a80" (UID: "c3f3a337-2118-4828-be24-022b15662a80"). InnerVolumeSpecName "kube-api-access-c8zbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:23:18.550030 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.549959 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f3a337-2118-4828-be24-022b15662a80-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:23:18.550030 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.550037 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8zbx\" (UniqueName: \"kubernetes.io/projected/c3f3a337-2118-4828-be24-022b15662a80-kube-api-access-c8zbx\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:23:18.881412 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.881244 2575 generic.go:356] "Generic (PLEG): container finished" podID="c3f3a337-2118-4828-be24-022b15662a80" containerID="5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b" exitCode=0 Sep 17 18:23:18.881412 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.881332 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" Sep 17 18:23:18.881412 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.881345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" event={"ID":"c3f3a337-2118-4828-be24-022b15662a80","Type":"ContainerDied","Data":"5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b"} Sep 17 18:23:18.882241 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.881439 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4" event={"ID":"c3f3a337-2118-4828-be24-022b15662a80","Type":"ContainerDied","Data":"b7e06fe45bc539e1d052ac969b494254eeca39b17cc3e9d1dc2f3ce06e902a89"} Sep 17 18:23:18.882241 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.881475 2575 scope.go:117] "RemoveContainer" containerID="5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b" Sep 17 18:23:18.893727 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.893688 2575 scope.go:117] "RemoveContainer" containerID="5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b" Sep 17 18:23:18.894252 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:23:18.894187 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b\": container with ID starting with 5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b not found: ID does not exist" containerID="5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b" Sep 17 18:23:18.894252 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.894239 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b"} err="failed to get container status \"5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b\": rpc error: code = NotFound desc = could not find container \"5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b\": container with ID starting with 5ee6b73cb94f6c19ee3ef3500515a166d4fa55f43e0352ea8ede9bb4a05c360b not found: ID does not exist" Sep 17 18:23:18.905100 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.905049 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4"] Sep 17 18:23:18.909004 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:18.908962 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-ch4c4"] Sep 17 18:23:20.342786 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:20.342749 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f3a337-2118-4828-be24-022b15662a80" path="/var/lib/kubelet/pods/c3f3a337-2118-4828-be24-022b15662a80/volumes" Sep 17 18:23:44.668422 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.668385 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4"] Sep 17 18:23:44.668911 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.668762 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" Sep 17 18:23:44.668911 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.668774 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" Sep 17 18:23:44.668911 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.668832 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f3a337-2118-4828-be24-022b15662a80" containerName="main" Sep 17 18:23:44.671723 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.671702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:44.674315 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.674289 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"openshift-service-ca.crt\"" Sep 17 18:23:44.674501 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.674321 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs\"" Sep 17 18:23:44.674501 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.674295 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"default-dockercfg-4wflw\"" Sep 17 18:23:44.674501 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.674373 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa-dockercfg-5clfv\"" Sep 17 18:23:44.674501 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.674293 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"kube-root-ca.crt\"" Sep 17 18:23:44.689868 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.685383 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4"] Sep 17 18:23:44.730204 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.730167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cr4w\" (UniqueName: \"kubernetes.io/projected/e06da42c-6520-488c-850c-adbf2ea152f2-kube-api-access-4cr4w\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:44.730378 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.730294 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e06da42c-6520-488c-850c-adbf2ea152f2-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:44.831204 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.831159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e06da42c-6520-488c-850c-adbf2ea152f2-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:44.831752 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.831287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr4w\" (UniqueName: \"kubernetes.io/projected/e06da42c-6520-488c-850c-adbf2ea152f2-kube-api-access-4cr4w\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:44.834483 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.834449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e06da42c-6520-488c-850c-adbf2ea152f2-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:44.840962 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.840934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cr4w\" (UniqueName: \"kubernetes.io/projected/e06da42c-6520-488c-850c-adbf2ea152f2-kube-api-access-4cr4w\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:44.983206 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:44.983107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:45.258197 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:45.258167 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4"] Sep 17 18:23:45.260479 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:23:45.260438 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06da42c_6520_488c_850c_adbf2ea152f2.slice/crio-7f25af6bb35364acd8c05ca02146851f208694fe1c0d667845e9ea4cdde38f9e WatchSource:0}: Error finding container 7f25af6bb35364acd8c05ca02146851f208694fe1c0d667845e9ea4cdde38f9e: Status 404 returned error can't find the container with id 7f25af6bb35364acd8c05ca02146851f208694fe1c0d667845e9ea4cdde38f9e Sep 17 18:23:46.040813 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:46.040772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" event={"ID":"e06da42c-6520-488c-850c-adbf2ea152f2","Type":"ContainerStarted","Data":"8c2f5fcc200e4b8198bf61320171ef65e57adea0e5512ec166d7aad532e4fb05"} Sep 17 18:23:46.041259 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:46.040834 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" event={"ID":"e06da42c-6520-488c-850c-adbf2ea152f2","Type":"ContainerStarted","Data":"7f25af6bb35364acd8c05ca02146851f208694fe1c0d667845e9ea4cdde38f9e"} Sep 17 18:23:46.041259 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:46.040860 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:23:46.060440 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:23:46.060391 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" podStartSLOduration=2.060374304 podStartE2EDuration="2.060374304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:23:46.059133937 +0000 UTC m=+2555.903277965" watchObservedRunningTime="2026-09-17 18:23:46.060374304 +0000 UTC m=+2555.904518333" Sep 17 18:24:17.048878 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:17.048850 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:24:26.561356 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.561276 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7"] Sep 17 18:24:26.566079 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.566057 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:26.568945 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.568919 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\"" Sep 17 18:24:26.568945 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.568936 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-vw7gx\"" Sep 17 18:24:26.569145 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.568966 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\"" Sep 17 18:24:26.569145 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.568919 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-6g652\"" Sep 17 18:24:26.569145 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.569049 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\"" Sep 17 18:24:26.573657 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.573632 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7"] Sep 17 18:24:26.702126 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.702104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c664436-1c04-47cf-b304-3bb400d080f7-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:26.702230 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.702153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pwzk\" (UniqueName: \"kubernetes.io/projected/8c664436-1c04-47cf-b304-3bb400d080f7-kube-api-access-7pwzk\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:26.803091 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.803064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c664436-1c04-47cf-b304-3bb400d080f7-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:26.803195 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.803115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pwzk\" (UniqueName: \"kubernetes.io/projected/8c664436-1c04-47cf-b304-3bb400d080f7-kube-api-access-7pwzk\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:26.805343 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.805326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c664436-1c04-47cf-b304-3bb400d080f7-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:26.810093 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.810070 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pwzk\" (UniqueName: \"kubernetes.io/projected/8c664436-1c04-47cf-b304-3bb400d080f7-kube-api-access-7pwzk\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:26.879792 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:26.879745 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:27.148642 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:27.148616 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7"] Sep 17 18:24:27.151144 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:24:27.151116 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c664436_1c04_47cf_b304_3bb400d080f7.slice/crio-1ee8cb6497cd6cc164eb2291c93ad011b6b8115b94143ebeb3939d879a17bb38 WatchSource:0}: Error finding container 1ee8cb6497cd6cc164eb2291c93ad011b6b8115b94143ebeb3939d879a17bb38: Status 404 returned error can't find the container with id 1ee8cb6497cd6cc164eb2291c93ad011b6b8115b94143ebeb3939d879a17bb38 Sep 17 18:24:27.240474 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:27.240423 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" event={"ID":"8c664436-1c04-47cf-b304-3bb400d080f7","Type":"ContainerStarted","Data":"4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658"} Sep 17 18:24:27.240641 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:27.240494 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" event={"ID":"8c664436-1c04-47cf-b304-3bb400d080f7","Type":"ContainerStarted","Data":"1ee8cb6497cd6cc164eb2291c93ad011b6b8115b94143ebeb3939d879a17bb38"} Sep 17 18:24:27.240787 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:27.240767 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:24:27.256093 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:27.256048 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" podStartSLOduration=1.256034629 podStartE2EDuration="1.256034629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:24:27.255158188 +0000 UTC m=+2597.099302215" watchObservedRunningTime="2026-09-17 18:24:27.256034629 +0000 UTC m=+2597.100178657" Sep 17 18:24:58.246564 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:24:58.246528 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:26:22.849960 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:22.849921 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4"] Sep 17 18:26:27.048791 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:27.048745 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:26:28.030939 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:28.030902 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7"] Sep 17 18:26:28.246767 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:28.246726 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:26:37.048373 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:37.048335 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:26:37.870765 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:37.870727 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" containerID="cri-o://8c2f5fcc200e4b8198bf61320171ef65e57adea0e5512ec166d7aad532e4fb05" gracePeriod=45 Sep 17 18:26:38.246412 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:38.246322 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:26:43.052093 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:43.052025 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" containerID="cri-o://4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658" gracePeriod=45 Sep 17 18:26:47.048309 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:47.048272 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:26:47.048755 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:47.048382 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:26:48.246555 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:48.246512 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:26:48.247111 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:48.246645 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:26:57.048652 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:57.048613 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:26:58.246316 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:26:58.246285 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:27:07.048476 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:07.048433 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:27:08.077192 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.077161 2575 generic.go:356] "Generic (PLEG): container finished" podID="e06da42c-6520-488c-850c-adbf2ea152f2" containerID="8c2f5fcc200e4b8198bf61320171ef65e57adea0e5512ec166d7aad532e4fb05" exitCode=0 Sep 17 18:27:08.077509 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.077204 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" event={"ID":"e06da42c-6520-488c-850c-adbf2ea152f2","Type":"ContainerDied","Data":"8c2f5fcc200e4b8198bf61320171ef65e57adea0e5512ec166d7aad532e4fb05"} Sep 17 18:27:08.110888 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.110867 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:27:08.235198 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.235139 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e06da42c-6520-488c-850c-adbf2ea152f2-tls-certs\") pod \"e06da42c-6520-488c-850c-adbf2ea152f2\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " Sep 17 18:27:08.235198 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.235178 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cr4w\" (UniqueName: \"kubernetes.io/projected/e06da42c-6520-488c-850c-adbf2ea152f2-kube-api-access-4cr4w\") pod \"e06da42c-6520-488c-850c-adbf2ea152f2\" (UID: \"e06da42c-6520-488c-850c-adbf2ea152f2\") " Sep 17 18:27:08.237375 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.237351 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06da42c-6520-488c-850c-adbf2ea152f2-kube-api-access-4cr4w" (OuterVolumeSpecName: "kube-api-access-4cr4w") pod "e06da42c-6520-488c-850c-adbf2ea152f2" (UID: "e06da42c-6520-488c-850c-adbf2ea152f2"). InnerVolumeSpecName "kube-api-access-4cr4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:27:08.237472 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.237355 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e06da42c-6520-488c-850c-adbf2ea152f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e06da42c-6520-488c-850c-adbf2ea152f2" (UID: "e06da42c-6520-488c-850c-adbf2ea152f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:27:08.246685 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.246659 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:27:08.336689 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.336666 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cr4w\" (UniqueName: \"kubernetes.io/projected/e06da42c-6520-488c-850c-adbf2ea152f2-kube-api-access-4cr4w\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:27:08.336689 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:08.336689 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e06da42c-6520-488c-850c-adbf2ea152f2-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:27:09.083187 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:09.083156 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" event={"ID":"e06da42c-6520-488c-850c-adbf2ea152f2","Type":"ContainerDied","Data":"7f25af6bb35364acd8c05ca02146851f208694fe1c0d667845e9ea4cdde38f9e"} Sep 17 18:27:09.083566 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:09.083212 2575 scope.go:117] "RemoveContainer" containerID="8c2f5fcc200e4b8198bf61320171ef65e57adea0e5512ec166d7aad532e4fb05" Sep 17 18:27:09.083566 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:09.083164 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4" Sep 17 18:27:09.097555 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:09.097525 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4"] Sep 17 18:27:09.099694 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:09.099670 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schefw9j4"] Sep 17 18:27:10.341667 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:10.341623 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" path="/var/lib/kubelet/pods/e06da42c-6520-488c-850c-adbf2ea152f2/volumes" Sep 17 18:27:13.311841 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:13.311766 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:27:13.383295 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:13.383252 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pwzk\" (UniqueName: \"kubernetes.io/projected/8c664436-1c04-47cf-b304-3bb400d080f7-kube-api-access-7pwzk\") pod \"8c664436-1c04-47cf-b304-3bb400d080f7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " Sep 17 18:27:13.383506 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:13.383365 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c664436-1c04-47cf-b304-3bb400d080f7-tls-certs\") pod \"8c664436-1c04-47cf-b304-3bb400d080f7\" (UID: \"8c664436-1c04-47cf-b304-3bb400d080f7\") " Sep 17 18:27:13.386242 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:13.386208 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c664436-1c04-47cf-b304-3bb400d080f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c664436-1c04-47cf-b304-3bb400d080f7" (UID: "8c664436-1c04-47cf-b304-3bb400d080f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:27:13.386242 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:13.386212 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c664436-1c04-47cf-b304-3bb400d080f7-kube-api-access-7pwzk" (OuterVolumeSpecName: "kube-api-access-7pwzk") pod "8c664436-1c04-47cf-b304-3bb400d080f7" (UID: "8c664436-1c04-47cf-b304-3bb400d080f7"). InnerVolumeSpecName "kube-api-access-7pwzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:27:13.484986 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:13.484946 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c664436-1c04-47cf-b304-3bb400d080f7-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:27:13.484986 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:13.484978 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pwzk\" (UniqueName: \"kubernetes.io/projected/8c664436-1c04-47cf-b304-3bb400d080f7-kube-api-access-7pwzk\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:27:14.111425 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.111394 2575 generic.go:356] "Generic (PLEG): container finished" podID="8c664436-1c04-47cf-b304-3bb400d080f7" containerID="4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658" exitCode=0 Sep 17 18:27:14.111605 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.111451 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" Sep 17 18:27:14.111605 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.111483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" event={"ID":"8c664436-1c04-47cf-b304-3bb400d080f7","Type":"ContainerDied","Data":"4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658"} Sep 17 18:27:14.111605 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.111539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7" event={"ID":"8c664436-1c04-47cf-b304-3bb400d080f7","Type":"ContainerDied","Data":"1ee8cb6497cd6cc164eb2291c93ad011b6b8115b94143ebeb3939d879a17bb38"} Sep 17 18:27:14.111605 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.111585 2575 scope.go:117] "RemoveContainer" containerID="4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658" Sep 17 18:27:14.120946 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.120929 2575 scope.go:117] "RemoveContainer" containerID="4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658" Sep 17 18:27:14.121229 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:27:14.121208 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658\": container with ID starting with 4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658 not found: ID does not exist" containerID="4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658" Sep 17 18:27:14.121294 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.121240 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658"} err="failed to get container status \"4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658\": rpc error: code = NotFound desc = could not find container \"4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658\": container with ID starting with 4999d69b2210f6bee96f7790459c34231413ceb2a858c20f52f3999900c93658 not found: ID does not exist" Sep 17 18:27:14.131384 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.131365 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7"] Sep 17 18:27:14.137651 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.137631 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-wmzt7"] Sep 17 18:27:14.346506 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:27:14.346461 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" path="/var/lib/kubelet/pods/8c664436-1c04-47cf-b304-3bb400d080f7/volumes" Sep 17 18:31:21.268073 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.268034 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr"] Sep 17 18:31:21.268655 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.268572 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" Sep 17 18:31:21.268655 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.268593 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" Sep 17 18:31:21.268655 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.268631 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" Sep 17 18:31:21.268655 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.268640 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" Sep 17 18:31:21.268870 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.268737 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c664436-1c04-47cf-b304-3bb400d080f7" containerName="main" Sep 17 18:31:21.268870 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.268751 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e06da42c-6520-488c-850c-adbf2ea152f2" containerName="main" Sep 17 18:31:21.272068 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.272041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.274522 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.274491 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-epp-sa-dockercfg-sqp57\"" Sep 17 18:31:21.274667 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.274543 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"openshift-service-ca.crt\"" Sep 17 18:31:21.274667 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.274577 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"kube-root-ca.crt\"" Sep 17 18:31:21.274667 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.274646 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"default-dockercfg-qdtrb\"" Sep 17 18:31:21.274824 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.274730 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-kserve-self-signed-certs\"" Sep 17 18:31:21.279613 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.279589 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr"] Sep 17 18:31:21.388226 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.388192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f00566f-a0d1-499c-a664-17ff897e5406-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.388408 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.388269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzcx4\" (UniqueName: \"kubernetes.io/projected/1f00566f-a0d1-499c-a664-17ff897e5406-kube-api-access-xzcx4\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.488849 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.488824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f00566f-a0d1-499c-a664-17ff897e5406-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.488990 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.488866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzcx4\" (UniqueName: \"kubernetes.io/projected/1f00566f-a0d1-499c-a664-17ff897e5406-kube-api-access-xzcx4\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.491480 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.491461 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f00566f-a0d1-499c-a664-17ff897e5406-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.496203 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.496179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzcx4\" (UniqueName: \"kubernetes.io/projected/1f00566f-a0d1-499c-a664-17ff897e5406-kube-api-access-xzcx4\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.584463 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.584406 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:21.854242 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:21.854095 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr"] Sep 17 18:31:21.857274 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:31:21.857244 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f00566f_a0d1_499c_a664_17ff897e5406.slice/crio-b82b1f7d44c4e8ff460fedc334576e6570c6881469e9e6d704c48b923b66e5e6 WatchSource:0}: Error finding container b82b1f7d44c4e8ff460fedc334576e6570c6881469e9e6d704c48b923b66e5e6: Status 404 returned error can't find the container with id b82b1f7d44c4e8ff460fedc334576e6570c6881469e9e6d704c48b923b66e5e6 Sep 17 18:31:22.318583 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:22.318539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" event={"ID":"1f00566f-a0d1-499c-a664-17ff897e5406","Type":"ContainerStarted","Data":"24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c"} Sep 17 18:31:22.319034 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:22.318607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" event={"ID":"1f00566f-a0d1-499c-a664-17ff897e5406","Type":"ContainerStarted","Data":"b82b1f7d44c4e8ff460fedc334576e6570c6881469e9e6d704c48b923b66e5e6"} Sep 17 18:31:22.319034 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:22.318633 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:31:22.336749 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:22.336697 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" podStartSLOduration=1.3366768740000001 podStartE2EDuration="1.336676874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:31:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:31:22.333088677 +0000 UTC m=+3012.177232705" watchObservedRunningTime="2026-09-17 18:31:22.336676874 +0000 UTC m=+3012.180820902" Sep 17 18:31:53.325706 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:31:53.325627 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:33:29.798131 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:33:29.798044 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr"] Sep 17 18:33:33.324906 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:33:33.324863 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:33:43.325658 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:33:43.325619 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:33:44.818753 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:33:44.818693 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" containerID="cri-o://24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c" gracePeriod=45 Sep 17 18:33:53.325849 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:33:53.325802 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:33:53.326318 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:33:53.325946 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:34:03.325703 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:03.325666 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:34:13.325442 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:13.325401 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:34:15.060664 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.060644 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:34:15.130589 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.130527 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzcx4\" (UniqueName: \"kubernetes.io/projected/1f00566f-a0d1-499c-a664-17ff897e5406-kube-api-access-xzcx4\") pod \"1f00566f-a0d1-499c-a664-17ff897e5406\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " Sep 17 18:34:15.130705 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.130614 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f00566f-a0d1-499c-a664-17ff897e5406-tls-certs\") pod \"1f00566f-a0d1-499c-a664-17ff897e5406\" (UID: \"1f00566f-a0d1-499c-a664-17ff897e5406\") " Sep 17 18:34:15.132647 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.132626 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f00566f-a0d1-499c-a664-17ff897e5406-kube-api-access-xzcx4" (OuterVolumeSpecName: "kube-api-access-xzcx4") pod "1f00566f-a0d1-499c-a664-17ff897e5406" (UID: "1f00566f-a0d1-499c-a664-17ff897e5406"). InnerVolumeSpecName "kube-api-access-xzcx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:34:15.132748 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.132661 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f00566f-a0d1-499c-a664-17ff897e5406-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f00566f-a0d1-499c-a664-17ff897e5406" (UID: "1f00566f-a0d1-499c-a664-17ff897e5406"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:34:15.166038 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.165996 2575 generic.go:356] "Generic (PLEG): container finished" podID="1f00566f-a0d1-499c-a664-17ff897e5406" containerID="24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c" exitCode=0 Sep 17 18:34:15.166156 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.166059 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" Sep 17 18:34:15.166156 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.166080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" event={"ID":"1f00566f-a0d1-499c-a664-17ff897e5406","Type":"ContainerDied","Data":"24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c"} Sep 17 18:34:15.166156 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.166137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr" event={"ID":"1f00566f-a0d1-499c-a664-17ff897e5406","Type":"ContainerDied","Data":"b82b1f7d44c4e8ff460fedc334576e6570c6881469e9e6d704c48b923b66e5e6"} Sep 17 18:34:15.166327 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.166163 2575 scope.go:117] "RemoveContainer" containerID="24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c" Sep 17 18:34:15.175151 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.175134 2575 scope.go:117] "RemoveContainer" containerID="24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c" Sep 17 18:34:15.175434 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:34:15.175411 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c\": container with ID starting with 24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c not found: ID does not exist" containerID="24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c" Sep 17 18:34:15.175488 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.175442 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c"} err="failed to get container status \"24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c\": rpc error: code = NotFound desc = could not find container \"24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c\": container with ID starting with 24aa67387bcc2abdd6ef53f8e329d758126bcb3980b35a7bd88f7ebaae5c9d0c not found: ID does not exist" Sep 17 18:34:15.185223 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.185200 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr"] Sep 17 18:34:15.189114 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.189093 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b45zfkgr"] Sep 17 18:34:15.231683 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.231662 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f00566f-a0d1-499c-a664-17ff897e5406-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:34:15.231683 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:15.231682 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzcx4\" (UniqueName: \"kubernetes.io/projected/1f00566f-a0d1-499c-a664-17ff897e5406-kube-api-access-xzcx4\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:34:16.341402 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:34:16.341360 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" path="/var/lib/kubelet/pods/1f00566f-a0d1-499c-a664-17ff897e5406/volumes" Sep 17 18:38:28.464876 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.464839 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m"] Sep 17 18:38:28.465521 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.465239 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" Sep 17 18:38:28.465521 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.465251 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" Sep 17 18:38:28.465521 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.465315 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f00566f-a0d1-499c-a664-17ff897e5406" containerName="main" Sep 17 18:38:28.468213 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.468195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:28.470854 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.470822 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"openshift-service-ca.crt\"" Sep 17 18:38:28.470970 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.470822 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"tls-verification-test-kserve-self-signed-certs\"" Sep 17 18:38:28.470970 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.470863 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"tls-verification-test-epp-sa-dockercfg-rxs62\"" Sep 17 18:38:28.470970 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.470864 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"kube-root-ca.crt\"" Sep 17 18:38:28.470970 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.470895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"default-dockercfg-c7h8l\"" Sep 17 18:38:28.478843 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.478822 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m"] Sep 17 18:38:28.499493 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.499471 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e541b6bc-0c26-4999-97aa-70c74cec1151-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:28.499612 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.499545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwn9\" (UniqueName: \"kubernetes.io/projected/e541b6bc-0c26-4999-97aa-70c74cec1151-kube-api-access-lnwn9\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:28.600288 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.600263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwn9\" (UniqueName: \"kubernetes.io/projected/e541b6bc-0c26-4999-97aa-70c74cec1151-kube-api-access-lnwn9\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:28.600382 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.600310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e541b6bc-0c26-4999-97aa-70c74cec1151-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:28.602800 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.602777 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e541b6bc-0c26-4999-97aa-70c74cec1151-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:28.607293 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.607270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwn9\" (UniqueName: \"kubernetes.io/projected/e541b6bc-0c26-4999-97aa-70c74cec1151-kube-api-access-lnwn9\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:28.779536 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:28.779507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:29.049397 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:29.049367 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m"] Sep 17 18:38:29.051973 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:38:29.051939 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode541b6bc_0c26_4999_97aa_70c74cec1151.slice/crio-be26c204f1f0722c135e91b05c949180c41a1b996119d59ff2fa6691adebbfe7 WatchSource:0}: Error finding container be26c204f1f0722c135e91b05c949180c41a1b996119d59ff2fa6691adebbfe7: Status 404 returned error can't find the container with id be26c204f1f0722c135e91b05c949180c41a1b996119d59ff2fa6691adebbfe7 Sep 17 18:38:29.397103 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:29.397019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" event={"ID":"e541b6bc-0c26-4999-97aa-70c74cec1151","Type":"ContainerStarted","Data":"8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a"} Sep 17 18:38:29.397103 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:29.397075 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" event={"ID":"e541b6bc-0c26-4999-97aa-70c74cec1151","Type":"ContainerStarted","Data":"be26c204f1f0722c135e91b05c949180c41a1b996119d59ff2fa6691adebbfe7"} Sep 17 18:38:29.397290 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:29.397116 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:38:29.436704 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:38:29.436636 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" podStartSLOduration=1.436617115 podStartE2EDuration="1.436617115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:38:29.423706058 +0000 UTC m=+3439.267850083" watchObservedRunningTime="2026-09-17 18:38:29.436617115 +0000 UTC m=+3439.280761146" Sep 17 18:39:00.403158 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:39:00.403127 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:40:23.601967 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:40:23.601934 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m"] Sep 17 18:40:30.403787 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:40:30.403749 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:40:38.621509 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:40:38.621459 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" containerID="cri-o://8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a" gracePeriod=45 Sep 17 18:40:40.403611 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:40:40.403580 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:40:50.403977 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:40:50.403930 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:40:50.404356 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:40:50.404064 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:41:00.403483 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:00.403405 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:41:08.859309 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:08.859282 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:41:08.965755 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:08.965697 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnwn9\" (UniqueName: \"kubernetes.io/projected/e541b6bc-0c26-4999-97aa-70c74cec1151-kube-api-access-lnwn9\") pod \"e541b6bc-0c26-4999-97aa-70c74cec1151\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " Sep 17 18:41:08.965755 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:08.965745 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e541b6bc-0c26-4999-97aa-70c74cec1151-tls-certs\") pod \"e541b6bc-0c26-4999-97aa-70c74cec1151\" (UID: \"e541b6bc-0c26-4999-97aa-70c74cec1151\") " Sep 17 18:41:08.967943 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:08.967916 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e541b6bc-0c26-4999-97aa-70c74cec1151-kube-api-access-lnwn9" (OuterVolumeSpecName: "kube-api-access-lnwn9") pod "e541b6bc-0c26-4999-97aa-70c74cec1151" (UID: "e541b6bc-0c26-4999-97aa-70c74cec1151"). InnerVolumeSpecName "kube-api-access-lnwn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:41:08.967943 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:08.967905 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e541b6bc-0c26-4999-97aa-70c74cec1151-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e541b6bc-0c26-4999-97aa-70c74cec1151" (UID: "e541b6bc-0c26-4999-97aa-70c74cec1151"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:41:09.066515 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.066494 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnwn9\" (UniqueName: \"kubernetes.io/projected/e541b6bc-0c26-4999-97aa-70c74cec1151-kube-api-access-lnwn9\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:41:09.066515 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.066514 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e541b6bc-0c26-4999-97aa-70c74cec1151-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:41:09.155457 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.155434 2575 generic.go:356] "Generic (PLEG): container finished" podID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerID="8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a" exitCode=0 Sep 17 18:41:09.155565 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.155477 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" Sep 17 18:41:09.155565 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.155528 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" event={"ID":"e541b6bc-0c26-4999-97aa-70c74cec1151","Type":"ContainerDied","Data":"8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a"} Sep 17 18:41:09.155688 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.155593 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m" event={"ID":"e541b6bc-0c26-4999-97aa-70c74cec1151","Type":"ContainerDied","Data":"be26c204f1f0722c135e91b05c949180c41a1b996119d59ff2fa6691adebbfe7"} Sep 17 18:41:09.155688 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.155629 2575 scope.go:117] "RemoveContainer" containerID="8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a" Sep 17 18:41:09.164211 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.164196 2575 scope.go:117] "RemoveContainer" containerID="8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a" Sep 17 18:41:09.164473 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:41:09.164457 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a\": container with ID starting with 8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a not found: ID does not exist" containerID="8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a" Sep 17 18:41:09.164516 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.164481 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a"} err="failed to get container status \"8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a\": rpc error: code = NotFound desc = could not find container \"8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a\": container with ID starting with 8dcb61610b8a39a0d96351a9707ce8662996783a38187061988c2676a691423a not found: ID does not exist" Sep 17 18:41:09.174938 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.174918 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m"] Sep 17 18:41:09.180764 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:09.180746 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-65k4m"] Sep 17 18:41:10.340019 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:41:10.339989 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" path="/var/lib/kubelet/pods/e541b6bc-0c26-4999-97aa-70c74cec1151/volumes" Sep 17 18:43:06.869228 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.869192 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7"] Sep 17 18:43:06.869646 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.869570 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" Sep 17 18:43:06.869646 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.869581 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" Sep 17 18:43:06.869720 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.869655 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e541b6bc-0c26-4999-97aa-70c74cec1151" containerName="main" Sep 17 18:43:06.872775 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.872753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:06.875560 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.875534 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"openshift-service-ca.crt\"" Sep 17 18:43:06.875739 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.875537 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"kube-root-ca.crt\"" Sep 17 18:43:06.875739 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.875652 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\"" Sep 17 18:43:06.875739 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.875680 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-4xnwf\"" Sep 17 18:43:06.875739 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.875697 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"default-dockercfg-dpmjb\"" Sep 17 18:43:06.882215 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.882189 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7"] Sep 17 18:43:06.908865 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.908839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ba56f6-bca2-4a0d-8205-91417603a814-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:06.908978 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:06.908958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc98l\" (UniqueName: \"kubernetes.io/projected/82ba56f6-bca2-4a0d-8205-91417603a814-kube-api-access-hc98l\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:07.009365 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.009336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ba56f6-bca2-4a0d-8205-91417603a814-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:07.009497 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.009395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc98l\" (UniqueName: \"kubernetes.io/projected/82ba56f6-bca2-4a0d-8205-91417603a814-kube-api-access-hc98l\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:07.011846 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.011825 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ba56f6-bca2-4a0d-8205-91417603a814-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:07.017195 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.017175 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc98l\" (UniqueName: \"kubernetes.io/projected/82ba56f6-bca2-4a0d-8205-91417603a814-kube-api-access-hc98l\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:07.184670 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.184608 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:07.457811 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.457786 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7"] Sep 17 18:43:07.459684 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:43:07.459660 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ba56f6_bca2_4a0d_8205_91417603a814.slice/crio-e595430f02ac4c873f9c70a607f228c843b93cefa356fc09db9dafef97599e41 WatchSource:0}: Error finding container e595430f02ac4c873f9c70a607f228c843b93cefa356fc09db9dafef97599e41: Status 404 returned error can't find the container with id e595430f02ac4c873f9c70a607f228c843b93cefa356fc09db9dafef97599e41 Sep 17 18:43:07.694369 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.694337 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" event={"ID":"82ba56f6-bca2-4a0d-8205-91417603a814","Type":"ContainerStarted","Data":"82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499"} Sep 17 18:43:07.694537 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.694389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" event={"ID":"82ba56f6-bca2-4a0d-8205-91417603a814","Type":"ContainerStarted","Data":"e595430f02ac4c873f9c70a607f228c843b93cefa356fc09db9dafef97599e41"} Sep 17 18:43:07.694537 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.694430 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:07.728169 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:07.727972 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" podStartSLOduration=1.727953822 podStartE2EDuration="1.727953822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:43:07.726819737 +0000 UTC m=+3717.570963766" watchObservedRunningTime="2026-09-17 18:43:07.727953822 +0000 UTC m=+3717.572097876" Sep 17 18:43:38.700398 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:38.700368 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:43:40.247994 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:40.247953 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7"] Sep 17 18:43:48.700728 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:48.700677 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:43:55.267910 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:55.267791 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" containerID="cri-o://82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499" gracePeriod=45 Sep 17 18:43:58.700716 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:43:58.700678 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:44:08.700836 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:08.700796 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:44:08.703398 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:08.700909 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:44:18.700381 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:18.700341 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:44:25.509842 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:25.509816 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:44:25.622684 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:25.622621 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ba56f6-bca2-4a0d-8205-91417603a814-tls-certs\") pod \"82ba56f6-bca2-4a0d-8205-91417603a814\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " Sep 17 18:44:25.622684 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:25.622673 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc98l\" (UniqueName: \"kubernetes.io/projected/82ba56f6-bca2-4a0d-8205-91417603a814-kube-api-access-hc98l\") pod \"82ba56f6-bca2-4a0d-8205-91417603a814\" (UID: \"82ba56f6-bca2-4a0d-8205-91417603a814\") " Sep 17 18:44:25.624687 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:25.624657 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ba56f6-bca2-4a0d-8205-91417603a814-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82ba56f6-bca2-4a0d-8205-91417603a814" (UID: "82ba56f6-bca2-4a0d-8205-91417603a814"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:44:25.624788 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:25.624712 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ba56f6-bca2-4a0d-8205-91417603a814-kube-api-access-hc98l" (OuterVolumeSpecName: "kube-api-access-hc98l") pod "82ba56f6-bca2-4a0d-8205-91417603a814" (UID: "82ba56f6-bca2-4a0d-8205-91417603a814"). InnerVolumeSpecName "kube-api-access-hc98l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:44:25.724050 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:25.724028 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc98l\" (UniqueName: \"kubernetes.io/projected/82ba56f6-bca2-4a0d-8205-91417603a814-kube-api-access-hc98l\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:44:25.724050 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:25.724048 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ba56f6-bca2-4a0d-8205-91417603a814-tls-certs\") on node \"ip-10-0-142-71.ec2.internal\" DevicePath \"\"" Sep 17 18:44:26.072109 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.072081 2575 generic.go:356] "Generic (PLEG): container finished" podID="82ba56f6-bca2-4a0d-8205-91417603a814" containerID="82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499" exitCode=0 Sep 17 18:44:26.072214 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.072124 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" Sep 17 18:44:26.072214 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.072163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" event={"ID":"82ba56f6-bca2-4a0d-8205-91417603a814","Type":"ContainerDied","Data":"82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499"} Sep 17 18:44:26.072214 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.072211 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7" event={"ID":"82ba56f6-bca2-4a0d-8205-91417603a814","Type":"ContainerDied","Data":"e595430f02ac4c873f9c70a607f228c843b93cefa356fc09db9dafef97599e41"} Sep 17 18:44:26.072346 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.072232 2575 scope.go:117] "RemoveContainer" containerID="82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499" Sep 17 18:44:26.080413 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.080391 2575 scope.go:117] "RemoveContainer" containerID="82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499" Sep 17 18:44:26.080633 ip-10-0-142-71 kubenswrapper[2575]: E0917 18:44:26.080616 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499\": container with ID starting with 82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499 not found: ID does not exist" containerID="82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499" Sep 17 18:44:26.080689 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.080640 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499"} err="failed to get container status \"82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499\": rpc error: code = NotFound desc = could not find container \"82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499\": container with ID starting with 82677502273e7ccd7a797d161400c7ea083f685c959e2a21861e5a967d6da499 not found: ID does not exist" Sep 17 18:44:26.091468 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.091449 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7"] Sep 17 18:44:26.096748 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.096723 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9zrdd7"] Sep 17 18:44:26.340810 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:44:26.340737 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" path="/var/lib/kubelet/pods/82ba56f6-bca2-4a0d-8205-91417603a814/volumes" Sep 17 18:46:46.424147 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:46:46.424116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qjwmh_0ce1d734-673c-41c3-8b28-5bc20c657725/discovery/0.log" Sep 17 18:46:47.242382 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:46:47.242352 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qjwmh_0ce1d734-673c-41c3-8b28-5bc20c657725/discovery/0.log" Sep 17 18:46:48.364993 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:46:48.364965 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6fc8f864f4-jzt6h_1d0e2912-29c4-4a3f-acb7-92ea08f24903/manager/0.log" Sep 17 18:46:48.381498 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:46:48.381474 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-rnwzx_abcb04e0-e6a2-44e9-ab22-7686e68f4997/manager/0.log" Sep 17 18:46:57.511205 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:46:57.511135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xbvhh_d91a8e46-100d-4354-8cf9-701190356708/global-pull-secret-syncer/0.log" Sep 17 18:46:57.604794 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:46:57.604770 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lvjhz_8e63fc9f-bfb4-44b2-9593-79bb966ab745/konnectivity-agent/0.log" Sep 17 18:46:57.728985 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:46:57.728962 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-71.ec2.internal_c5e35a777e08f96da9ac1513824707b6/haproxy/0.log" Sep 17 18:47:02.383879 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:02.383848 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6fc8f864f4-jzt6h_1d0e2912-29c4-4a3f-acb7-92ea08f24903/manager/0.log" Sep 17 18:47:02.425863 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:02.425840 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-rnwzx_abcb04e0-e6a2-44e9-ab22-7686e68f4997/manager/0.log" Sep 17 18:47:04.249993 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.249961 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5/alertmanager/0.log" Sep 17 18:47:04.302491 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.302467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5/config-reloader/0.log" Sep 17 18:47:04.340646 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.340623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5/kube-rbac-proxy-web/0.log" Sep 17 18:47:04.368410 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.368392 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5/kube-rbac-proxy/0.log" Sep 17 18:47:04.399257 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.399210 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5/kube-rbac-proxy-metric/0.log" Sep 17 18:47:04.424107 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.424092 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5/prom-label-proxy/0.log" Sep 17 18:47:04.448159 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.448145 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a3ab926b-da6e-46fb-bdaa-3fdb7cb7e0a5/init-config-reloader/0.log" Sep 17 18:47:04.529355 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.529331 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-m4qw8_0096f40f-0f72-48f1-bb91-74477aa31902/kube-state-metrics/0.log" Sep 17 18:47:04.550644 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.550623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-m4qw8_0096f40f-0f72-48f1-bb91-74477aa31902/kube-rbac-proxy-main/0.log" Sep 17 18:47:04.572477 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.572458 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-m4qw8_0096f40f-0f72-48f1-bb91-74477aa31902/kube-rbac-proxy-self/0.log" Sep 17 18:47:04.606151 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.606129 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56c8f5fbb4-l7kl4_9ed832fe-1e93-4c8b-8529-59ad38124cb2/metrics-server/0.log" Sep 17 18:47:04.635285 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.635265 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-sn442_e77eafce-5037-453d-b6b4-130343900637/monitoring-plugin/0.log" Sep 17 18:47:04.668679 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.668661 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vkwc_b7c05f47-5e76-4122-a090-b5e34da2608e/node-exporter/0.log" Sep 17 18:47:04.700106 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.700089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vkwc_b7c05f47-5e76-4122-a090-b5e34da2608e/kube-rbac-proxy/0.log" Sep 17 18:47:04.724129 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.724115 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vkwc_b7c05f47-5e76-4122-a090-b5e34da2608e/init-textfile/0.log" Sep 17 18:47:04.917789 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.917742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-95br2_cf64ae51-8660-48c0-ac47-79a6e166d709/kube-rbac-proxy-main/0.log" Sep 17 18:47:04.947846 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.947828 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-95br2_cf64ae51-8660-48c0-ac47-79a6e166d709/kube-rbac-proxy-self/0.log" Sep 17 18:47:04.970099 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:04.970080 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-95br2_cf64ae51-8660-48c0-ac47-79a6e166d709/openshift-state-metrics/0.log" Sep 17 18:47:05.016340 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.016321 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657/prometheus/0.log" Sep 17 18:47:05.035286 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.035269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657/config-reloader/0.log" Sep 17 18:47:05.058763 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.058747 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657/thanos-sidecar/0.log" Sep 17 18:47:05.081196 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.081178 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657/kube-rbac-proxy-web/0.log" Sep 17 18:47:05.102153 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.102135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657/kube-rbac-proxy/0.log" Sep 17 18:47:05.122343 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.122325 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657/kube-rbac-proxy-thanos/0.log" Sep 17 18:47:05.144409 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.144393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5ae8ea5-9a73-4cae-8ccb-eeb0bd5d6657/init-config-reloader/0.log" Sep 17 18:47:05.177075 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.177029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-c9k4m_091557c3-ba28-4f7a-817b-b23d7bddfc73/prometheus-operator/0.log" Sep 17 18:47:05.194866 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.194850 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-c9k4m_091557c3-ba28-4f7a-817b-b23d7bddfc73/kube-rbac-proxy/0.log" Sep 17 18:47:05.258523 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.258504 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56bfbb9478-j9f57_cf972848-6f27-4f21-a60a-a45fb0b1949e/telemeter-client/0.log" Sep 17 18:47:05.280839 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.280823 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56bfbb9478-j9f57_cf972848-6f27-4f21-a60a-a45fb0b1949e/reload/0.log" Sep 17 18:47:05.303913 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.303898 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56bfbb9478-j9f57_cf972848-6f27-4f21-a60a-a45fb0b1949e/kube-rbac-proxy/0.log" Sep 17 18:47:05.342761 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.342747 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f54c5d9fb-mbbzf_649b0484-b3d4-4ab1-815d-928a5e676441/thanos-query/0.log" Sep 17 18:47:05.362530 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.362509 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f54c5d9fb-mbbzf_649b0484-b3d4-4ab1-815d-928a5e676441/kube-rbac-proxy-web/0.log" Sep 17 18:47:05.384345 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.384328 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f54c5d9fb-mbbzf_649b0484-b3d4-4ab1-815d-928a5e676441/kube-rbac-proxy/0.log" Sep 17 18:47:05.406743 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.406723 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f54c5d9fb-mbbzf_649b0484-b3d4-4ab1-815d-928a5e676441/prom-label-proxy/0.log" Sep 17 18:47:05.429797 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.429737 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f54c5d9fb-mbbzf_649b0484-b3d4-4ab1-815d-928a5e676441/kube-rbac-proxy-rules/0.log" Sep 17 18:47:05.454356 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:05.454338 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f54c5d9fb-mbbzf_649b0484-b3d4-4ab1-815d-928a5e676441/kube-rbac-proxy-metrics/0.log" Sep 17 18:47:08.175690 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.175658 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f975dcdd8-jbrl7_8c0bfe0e-2f46-4b30-a188-22fe9a151055/console/0.log" Sep 17 18:47:08.539409 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.539371 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c"] Sep 17 18:47:08.539783 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.539767 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" Sep 17 18:47:08.539836 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.539785 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" Sep 17 18:47:08.539872 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.539862 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ba56f6-bca2-4a0d-8205-91417603a814" containerName="main" Sep 17 18:47:08.543086 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.543067 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.545151 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.545131 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rx6xt\"/\"openshift-service-ca.crt\"" Sep 17 18:47:08.545502 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.545487 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rx6xt\"/\"kube-root-ca.crt\"" Sep 17 18:47:08.545554 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.545515 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rx6xt\"/\"default-dockercfg-lm5ng\"" Sep 17 18:47:08.553734 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.553715 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c"] Sep 17 18:47:08.603775 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.603750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-podres\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.603878 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.603780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-lib-modules\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.603878 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.603813 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-proc\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.603961 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.603897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-sys\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.603961 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.603936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzw2j\" (UniqueName: \"kubernetes.io/projected/c9e46f93-8870-4bbf-a262-bf5a6efea232-kube-api-access-xzw2j\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704365 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704331 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-lib-modules\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704513 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-proc\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704513 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-sys\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704620 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-sys\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704620 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-proc\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704620 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-lib-modules\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704620 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzw2j\" (UniqueName: \"kubernetes.io/projected/c9e46f93-8870-4bbf-a262-bf5a6efea232-kube-api-access-xzw2j\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704784 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-podres\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.704784 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.704757 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9e46f93-8870-4bbf-a262-bf5a6efea232-podres\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.712375 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.712356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzw2j\" (UniqueName: \"kubernetes.io/projected/c9e46f93-8870-4bbf-a262-bf5a6efea232-kube-api-access-xzw2j\") pod \"perf-node-gather-daemonset-tcb2c\" (UID: \"c9e46f93-8870-4bbf-a262-bf5a6efea232\") " pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:08.854974 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:08.854896 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:09.123454 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:09.123428 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c"] Sep 17 18:47:09.125841 ip-10-0-142-71 kubenswrapper[2575]: W0917 18:47:09.125817 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc9e46f93_8870_4bbf_a262_bf5a6efea232.slice/crio-423c4df38f33aeb3b7ad9ac804eae329f4e685f539a4361294ce4db59708f040 WatchSource:0}: Error finding container 423c4df38f33aeb3b7ad9ac804eae329f4e685f539a4361294ce4db59708f040: Status 404 returned error can't find the container with id 423c4df38f33aeb3b7ad9ac804eae329f4e685f539a4361294ce4db59708f040 Sep 17 18:47:09.870197 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:09.870164 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" event={"ID":"c9e46f93-8870-4bbf-a262-bf5a6efea232","Type":"ContainerStarted","Data":"bcc64f716a307ceca78c0889109294cec8d6ec4bf9c5dd26d23b56310c508de4"} Sep 17 18:47:09.870631 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:09.870215 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" event={"ID":"c9e46f93-8870-4bbf-a262-bf5a6efea232","Type":"ContainerStarted","Data":"423c4df38f33aeb3b7ad9ac804eae329f4e685f539a4361294ce4db59708f040"} Sep 17 18:47:09.870631 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:09.870275 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:09.885464 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:09.885412 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" podStartSLOduration=1.885398029 podStartE2EDuration="1.885398029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:47:09.884149323 +0000 UTC m=+3959.728293351" watchObservedRunningTime="2026-09-17 18:47:09.885398029 +0000 UTC m=+3959.729542059" Sep 17 18:47:09.970116 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:09.970087 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-82njx_6dddc8f0-90c1-428d-a1bf-769187a32773/dns/0.log" Sep 17 18:47:09.989774 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:09.989756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-82njx_6dddc8f0-90c1-428d-a1bf-769187a32773/kube-rbac-proxy/0.log" Sep 17 18:47:10.060003 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:10.059976 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6s8cq_62040b3e-71ad-4ee6-a954-853b6df70e6d/dns-node-resolver/0.log" Sep 17 18:47:10.711277 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:10.711249 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pl5mt_f2bc57f3-e523-4ac0-9a35-d6d0e30fdef2/node-ca/0.log" Sep 17 18:47:11.754032 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:11.753988 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qjwmh_0ce1d734-673c-41c3-8b28-5bc20c657725/discovery/0.log" Sep 17 18:47:12.473330 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:12.473303 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2cl2_0e945ef4-334c-45cf-b21e-e55cf41c90d3/serve-healthcheck-canary/0.log" Sep 17 18:47:13.187777 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:13.187742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wngkk_2eaf22e0-8f5e-465b-a340-b8778eaa7bf2/kube-rbac-proxy/0.log" Sep 17 18:47:13.207793 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:13.207769 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wngkk_2eaf22e0-8f5e-465b-a340-b8778eaa7bf2/exporter/0.log" Sep 17 18:47:13.229369 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:13.229342 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wngkk_2eaf22e0-8f5e-465b-a340-b8778eaa7bf2/extractor/0.log" Sep 17 18:47:15.884543 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:15.884516 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rx6xt/perf-node-gather-daemonset-tcb2c" Sep 17 18:47:16.237172 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:16.237098 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68dc9b9bc-djqwn_056eeb71-4f39-4df2-808f-c9c2ec6b0a62/manager/0.log" Sep 17 18:47:16.285061 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:16.285031 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wjhw8_3ef9543f-e1dc-4378-91c0-730ba1891c68/openshift-lws-operator/0.log" Sep 17 18:47:18.639267 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:18.639174 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qjwmh_0ce1d734-673c-41c3-8b28-5bc20c657725/discovery/0.log" Sep 17 18:47:19.914343 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:19.914312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qjwmh_0ce1d734-673c-41c3-8b28-5bc20c657725/discovery/0.log" Sep 17 18:47:25.287459 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.287386 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j9bdn_b69366f1-b9cc-445d-9925-e42f2b8cb129/kube-multus-additional-cni-plugins/0.log" Sep 17 18:47:25.307711 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.307689 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j9bdn_b69366f1-b9cc-445d-9925-e42f2b8cb129/egress-router-binary-copy/0.log" Sep 17 18:47:25.328966 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.328947 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j9bdn_b69366f1-b9cc-445d-9925-e42f2b8cb129/cni-plugins/0.log" Sep 17 18:47:25.349767 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.349743 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j9bdn_b69366f1-b9cc-445d-9925-e42f2b8cb129/bond-cni-plugin/0.log" Sep 17 18:47:25.371037 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.370991 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j9bdn_b69366f1-b9cc-445d-9925-e42f2b8cb129/routeoverride-cni/0.log" Sep 17 18:47:25.393647 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.393623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j9bdn_b69366f1-b9cc-445d-9925-e42f2b8cb129/whereabouts-cni-bincopy/0.log" Sep 17 18:47:25.419528 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.419503 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j9bdn_b69366f1-b9cc-445d-9925-e42f2b8cb129/whereabouts-cni/0.log" Sep 17 18:47:25.784209 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.784178 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c4hnh_3a0fc094-7d0a-4f58-b092-0931601d37f0/kube-multus/0.log" Sep 17 18:47:25.908474 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.908451 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5pcvf_5c5f7454-c62e-479a-97d7-68468080eb78/network-metrics-daemon/0.log" Sep 17 18:47:25.930417 ip-10-0-142-71 kubenswrapper[2575]: I0917 18:47:25.930396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5pcvf_5c5f7454-c62e-479a-97d7-68468080eb78/kube-rbac-proxy/0.log"