Sep 17 18:29:32.569395 ip-10-0-138-98 systemd[1]: Starting Kubernetes Kubelet... Sep 17 18:29:35.844141 ip-10-0-138-98 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:29:35.844141 ip-10-0-138-98 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 18:29:35.844141 ip-10-0-138-98 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:29:35.844141 ip-10-0-138-98 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 18:29:35.844141 ip-10-0-138-98 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:29:35.844931 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.844212 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 18:29:35.847759 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847742 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:29:35.847759 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847759 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847763 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847766 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847769 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847772 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847775 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847778 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847780 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847783 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847786 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847789 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847792 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847795 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847797 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847800 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847803 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847806 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847809 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847811 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847814 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:29:35.847820 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847817 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847819 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847822 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847825 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847828 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847832 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847835 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847838 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847840 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847843 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847845 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847848 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847850 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847853 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847855 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847858 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847860 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847864 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847866 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847869 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:29:35.848297 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847871 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847873 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847876 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847878 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847881 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847884 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847886 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847889 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847892 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847894 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847896 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847899 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847901 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847904 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847907 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847910 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847912 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847915 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847918 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:29:35.848778 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847920 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847923 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847925 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847928 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847930 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847933 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847935 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847938 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847940 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847943 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847946 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847949 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847951 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847954 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847956 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847960 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847963 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847966 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847969 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:29:35.849265 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847972 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847976 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847991 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847994 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.847997 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848001 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848004 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848007 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848011 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848014 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848016 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848019 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848022 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848025 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848028 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848031 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848034 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848036 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848039 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:29:35.849758 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848042 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848708 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848716 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848720 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848723 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848727 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848729 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848732 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848735 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848737 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848740 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848742 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848745 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848747 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848750 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848752 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848755 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848757 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848760 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:29:35.850245 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848762 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848764 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848769 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848771 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848774 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848777 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848779 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848782 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848785 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848787 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848790 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848793 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848796 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848799 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848802 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848804 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848807 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848810 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848812 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848815 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:29:35.850721 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848817 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848820 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848822 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848824 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848827 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848830 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848832 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848835 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848837 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848839 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848842 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848845 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848847 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848850 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848853 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848855 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848858 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848860 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848863 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848866 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:29:35.851212 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848868 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848871 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848873 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848876 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848879 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848882 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848887 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848889 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848892 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848895 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848897 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848900 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848902 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848905 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848907 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848910 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848912 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848915 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848918 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848920 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:29:35.851691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848923 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848925 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848928 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848930 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848933 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848936 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848939 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848943 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848947 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848950 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848953 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848956 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848959 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848962 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848965 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848969 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848972 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848975 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.848995 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:29:35.852171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849000 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849004 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849409 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849415 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849418 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849421 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849424 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849428 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849431 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849434 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849437 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849440 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849443 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849446 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849449 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849452 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849454 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849457 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849460 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849463 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:29:35.852627 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849465 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849468 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849471 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849473 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849476 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849479 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849481 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849484 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849486 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849489 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849491 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849494 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849497 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849500 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849504 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849506 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849509 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849511 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849514 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849517 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:29:35.853107 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849519 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849522 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849524 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849527 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849529 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849532 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849534 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849537 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849539 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849542 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849544 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849547 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849550 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849552 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849555 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849558 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849560 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849563 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849565 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849568 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:29:35.853615 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849570 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849573 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849575 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849577 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849580 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849583 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849589 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849591 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849594 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849596 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849599 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849601 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849603 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849606 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849608 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849611 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849616 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849619 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849622 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:29:35.854138 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849625 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849627 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849630 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849633 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849635 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849638 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849641 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849644 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849646 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849649 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849651 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849654 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849656 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849660 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849664 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849668 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849671 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849673 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849676 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:29:35.854674 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849680 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849683 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.849685 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849746 2585 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849777 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849784 2585 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849789 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849793 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849797 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849801 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849805 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849808 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849812 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849815 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849819 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849822 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849825 2585 flags.go:64] FLAG: --cgroup-root="" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849828 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849831 2585 flags.go:64] FLAG: --client-ca-file="" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849834 2585 flags.go:64] FLAG: --cloud-provider="external" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849837 2585 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849841 2585 flags.go:64] FLAG: --cluster-domain="" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849844 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849847 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 18:29:35.855141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849850 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849854 2585 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849857 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849861 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849864 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849867 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849870 2585 flags.go:64] FLAG: --contention-profiling="false" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849873 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849878 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849881 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849885 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849889 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849893 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849896 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849899 2585 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849902 2585 flags.go:64] FLAG: --enable-server="true" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849905 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849910 2585 flags.go:64] FLAG: --event-burst="100" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849913 2585 flags.go:64] FLAG: --event-qps="50" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849916 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849919 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849922 2585 flags.go:64] FLAG: --eviction-hard="" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849926 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849929 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849932 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 18:29:35.855711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849935 2585 flags.go:64] FLAG: --eviction-soft="" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849938 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849941 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849944 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849947 2585 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849950 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849953 2585 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849956 2585 flags.go:64] FLAG: --feature-gates="" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849960 2585 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849963 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849966 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849969 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849972 2585 flags.go:64] FLAG: --healthz-port="10248" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849975 2585 flags.go:64] FLAG: --help="false" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849978 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-138-98.ec2.internal" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.849997 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850000 2585 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850004 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850007 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850012 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850015 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850018 2585 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850020 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 18:29:35.856311 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850024 2585 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850027 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850030 2585 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850033 2585 flags.go:64] FLAG: --kube-reserved="" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850036 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850038 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850041 2585 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850044 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850047 2585 flags.go:64] FLAG: --lock-file="" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850050 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850053 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850056 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850062 2585 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850065 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850068 2585 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850071 2585 flags.go:64] FLAG: --logging-format="text" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850073 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850077 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850079 2585 flags.go:64] FLAG: --manifest-url="" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850082 2585 flags.go:64] FLAG: --manifest-url-header="" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850086 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850089 2585 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850093 2585 flags.go:64] FLAG: --max-pods="110" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850096 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850100 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 18:29:35.856910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850103 2585 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850106 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850110 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850114 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850117 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850124 2585 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850127 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850130 2585 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850133 2585 flags.go:64] FLAG: --pod-cidr="" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850136 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850142 2585 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850144 2585 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850148 2585 flags.go:64] FLAG: --pods-per-core="0" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850150 2585 flags.go:64] FLAG: --port="10250" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850154 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850156 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-097de6c230d26d950" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850160 2585 flags.go:64] FLAG: --qos-reserved="" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850162 2585 flags.go:64] FLAG: --read-only-port="10255" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850166 2585 flags.go:64] FLAG: --register-node="true" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850168 2585 flags.go:64] FLAG: --register-with-taints="" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850172 2585 flags.go:64] FLAG: --registry-burst="10" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850175 2585 flags.go:64] FLAG: --registry-qps="5" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850178 2585 flags.go:64] FLAG: --reserved-cpus="" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850181 2585 flags.go:64] FLAG: --reserved-memory="" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850184 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 18:29:35.857544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850187 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850191 2585 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850193 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850196 2585 flags.go:64] FLAG: --runonce="false" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850199 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850202 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850206 2585 flags.go:64] FLAG: --seccomp-default="false" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850209 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850212 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850215 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850219 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850224 2585 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850227 2585 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850230 2585 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850233 2585 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850236 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850239 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850242 2585 flags.go:64] FLAG: --system-cgroups="" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850245 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850250 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850253 2585 flags.go:64] FLAG: --tls-cert-file="" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850256 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850260 2585 flags.go:64] FLAG: --tls-min-version="" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850263 2585 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850266 2585 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 18:29:35.858187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850269 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850272 2585 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850275 2585 flags.go:64] FLAG: --v="2" Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850278 2585 flags.go:64] FLAG: --version="false" Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850282 2585 flags.go:64] FLAG: --vmodule="" Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850285 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.850289 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850395 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850398 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850401 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850403 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850406 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850409 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850413 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850415 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850418 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850420 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850423 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850427 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850430 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850433 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:29:35.859217 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850435 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850438 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850441 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850444 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850446 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850449 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850470 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850473 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850476 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850478 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850481 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850484 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850486 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850489 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850492 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850494 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850497 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850499 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850502 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850504 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:29:35.860083 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850507 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850509 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850512 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850514 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850518 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850521 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850524 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850527 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850529 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850533 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850540 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850543 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850545 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850548 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850550 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850553 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850555 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850558 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850562 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850565 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:29:35.860906 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850568 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850571 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850574 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850576 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850579 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850581 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850585 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850588 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850592 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850595 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850598 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850600 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850603 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850606 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850609 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850612 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850617 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850620 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850623 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:29:35.861513 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850627 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850629 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850634 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850636 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850639 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850642 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850645 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850647 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850649 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850652 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850655 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850657 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850660 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850662 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850664 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850667 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850670 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850672 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850675 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850677 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:29:35.862334 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850680 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850682 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850685 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850687 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850690 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.850692 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.851258 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.858111 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.858125 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.858144 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.858150 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859385 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859399 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859405 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859409 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:29:35.863146 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859416 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859433 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859438 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859443 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859466 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859637 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859655 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859661 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859669 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859676 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859682 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859687 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859693 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859697 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859702 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859706 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859710 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859714 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859719 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:29:35.863561 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859723 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859727 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859731 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859735 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859740 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859744 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859748 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859752 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859756 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859761 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859765 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859769 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859772 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859777 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859781 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859786 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859790 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859794 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859813 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859819 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:29:35.864249 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859823 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859828 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859832 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859837 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859840 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859845 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859849 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859854 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859858 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859862 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859866 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859870 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859874 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859878 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859882 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859886 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859890 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859894 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859898 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859902 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:29:35.864789 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859906 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859910 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859915 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859919 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859923 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859926 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859931 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859935 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859939 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859943 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859948 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859953 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859957 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859961 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859965 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859969 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859973 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859978 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.859997 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860001 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:29:35.865374 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860005 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860009 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860012 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860016 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860020 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860024 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860027 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860031 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860037 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860043 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860048 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860053 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860056 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860061 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860065 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:29:35.865859 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860069 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.860078 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860269 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860277 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860282 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860286 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860291 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860295 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860301 2585 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860305 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860309 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860314 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860318 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860322 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860326 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:29:35.866299 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860330 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860334 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860339 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860343 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860347 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860351 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860355 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860359 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860363 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860367 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860371 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860376 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860381 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860385 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860389 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860393 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860399 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860403 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860407 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:29:35.866826 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860411 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860416 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860419 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860423 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860430 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860435 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860440 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860445 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860450 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860454 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860460 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860464 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860468 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860471 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860476 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860480 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860484 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860488 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860492 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:29:35.867589 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860496 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860500 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860504 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860509 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860513 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860517 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860522 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860526 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860529 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860534 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860538 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860542 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860546 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860550 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860554 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860558 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860565 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860570 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860575 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860580 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:29:35.868126 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860584 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860588 2585 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860592 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860596 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860600 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860604 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860608 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860612 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860616 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860621 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860625 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860630 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860634 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860638 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860642 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860646 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860650 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860654 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860658 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860662 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:29:35.868910 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860666 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860670 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860674 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860678 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860682 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860686 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860690 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:35.860694 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.860702 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.860859 2585 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.863607 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.864464 2585 server.go:1019] "Starting client certificate rotation" Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.864562 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 18:29:35.869761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.865322 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 18:29:35.870292 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.867152 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 18:29:35.870292 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.869687 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 18:29:35.874825 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.874807 2585 log.go:25] "Validated CRI v1 runtime API" Sep 17 18:29:35.876424 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.876411 2585 log.go:25] "Validated CRI v1 image API" Sep 17 18:29:35.877194 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.877181 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 18:29:35.881784 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.881766 2585 fs.go:135] Filesystem UUIDs: map[2e5dd962-aade-475d-a244-9d8e4ad2f7f8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d242e29b-6f06-47a4-9e02-ce5300002215:/dev/nvme0n1p3] Sep 17 18:29:35.881841 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.881784 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 18:29:35.886901 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.886782 2585 manager.go:216] Machine: {Timestamp:2026-09-17 18:29:35.886311076 +0000 UTC m=+1.823699933 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3183199 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2af46699c4ed73059db5d6ec574d17 SystemUUID:ec2af466-99c4-ed73-059d-b5d6ec574d17 BootID:e6fa95c1-fb6a-4f7f-b4fc-392911b6c371 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ef:08:b1:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ef:08:b1:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:9f:8b:b6:d6:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 18:29:35.886901 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.886896 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 18:29:35.887017 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.886966 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 18:29:35.888461 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.888439 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 18:29:35.888587 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.888464 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 18:29:35.889641 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.889630 2585 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 18:29:35.889685 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.889644 2585 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 18:29:35.889685 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.889651 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 18:29:35.889685 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.889662 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 18:29:35.889761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.889733 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 18:29:35.893664 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.893650 2585 state_mem.go:36] "Initialized new in-memory state store" Sep 17 18:29:35.893822 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.893812 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 18:29:35.893857 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.893847 2585 kubelet.go:486] "Attempting to sync node with API server" Sep 17 18:29:35.893895 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.893862 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 18:29:35.893895 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.893873 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 18:29:35.893895 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.893882 2585 kubelet.go:398] "Adding apiserver pod source" Sep 17 18:29:35.893895 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.893891 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 18:29:35.894252 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.894241 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 18:29:35.894293 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.894258 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 18:29:35.899583 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.899562 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 18:29:35.900609 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.900594 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 18:29:35.902261 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.902238 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 18:29:35.902301 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.902290 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 18:29:35.903425 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903413 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903428 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903435 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903440 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903448 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903453 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903466 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903471 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 18:29:35.903476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903477 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 18:29:35.903702 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903483 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 18:29:35.903702 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903492 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 18:29:35.903702 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903497 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 18:29:35.903702 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903522 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 18:29:35.903702 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.903527 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 18:29:35.907455 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.907440 2585 server.go:1268] "Started kubelet" Sep 17 18:29:35.907547 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.907510 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 18:29:35.907599 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.907525 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 18:29:35.907648 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.907597 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 18:29:35.908293 ip-10-0-138-98 systemd[1]: Started Kubernetes Kubelet. Sep 17 18:29:35.908757 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.908498 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 18:29:35.908757 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.908573 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 18:29:35.908757 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.908686 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 18:29:35.908925 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.908908 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 18:29:35.909865 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.909852 2585 server.go:310] "Adding debug handlers to kubelet server" Sep 17 18:29:35.912782 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.912763 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 18:29:35.914899 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.914885 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 18:29:35.915018 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.914901 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 18:29:35.915018 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.914952 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:35.915523 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.915501 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 18:29:35.915523 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.915503 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 18:29:35.915523 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.915525 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 18:29:35.915684 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.915657 2585 reconstruct.go:97] "Volume reconstruction finished" Sep 17 18:29:35.915684 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.915665 2585 reconciler.go:29] "Reconciler: start to sync state" Sep 17 18:29:35.916529 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.916514 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 18:29:35.916529 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.916526 2585 factory.go:55] Registering systemd factory Sep 17 18:29:35.916529 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.916534 2585 factory.go:223] Registration of the systemd container factory successfully Sep 17 18:29:35.916754 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.916736 2585 factory.go:153] Registering CRI-O factory Sep 17 18:29:35.916823 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.916757 2585 factory.go:223] Registration of the crio container factory successfully Sep 17 18:29:35.916823 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.916774 2585 factory.go:103] Registering Raw factory Sep 17 18:29:35.916823 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.916770 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 18:29:35.916823 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.916785 2585 manager.go:1196] Started watching for new ooms in manager Sep 17 18:29:35.916823 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.916769 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 18:29:35.917430 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.917413 2585 manager.go:349] Starting recovery of all containers Sep 17 18:29:35.937070 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.937037 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvctl" Sep 17 18:29:35.937070 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.937071 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvctl" Sep 17 18:29:35.942457 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.942440 2585 manager.go:354] Recovery completed Sep 17 18:29:35.946376 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.946363 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:29:35.948263 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.948246 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:29:35.948329 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.948274 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:29:35.948329 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.948292 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:29:35.948833 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.948809 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 18:29:35.948833 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.948832 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 18:29:35.949055 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.948850 2585 state_mem.go:36] "Initialized new in-memory state store" Sep 17 18:29:35.949055 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.948816 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:29:35.949650 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.949638 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:29:35.949688 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.949662 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:29:35.949688 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.949672 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:29:35.950802 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.950791 2585 policy_none.go:49] "None policy: Start" Sep 17 18:29:35.950844 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.950806 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 18:29:35.950844 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.950815 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 18:29:35.952752 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.952741 2585 policy_none.go:47] "Start" Sep 17 18:29:35.990580 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.990565 2585 manager.go:337] "Starting Device Plugin manager" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.990615 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.990629 2585 server.go:87] "Starting device plugin registration server" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.990862 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.990883 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.990969 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.991055 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.991064 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.991560 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.991612 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.997747 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.998874 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.998935 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:35.998969 2585 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:35.999056 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 18:29:36.008464 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.000881 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:29:36.091165 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.091126 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:29:36.092104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.092084 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:29:36.092193 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.092120 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:29:36.092193 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.092133 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:29:36.092193 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.092156 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.099536 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.099480 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal"] Sep 17 18:29:36.099611 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.099546 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:29:36.100306 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.100291 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:29:36.100373 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.100316 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:29:36.100373 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.100325 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:29:36.100473 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.100458 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.100523 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.100483 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-98.ec2.internal\": node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.102614 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.102602 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:29:36.102730 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.102717 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.102775 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.102744 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:29:36.103301 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.103284 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:29:36.103374 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.103306 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:29:36.103374 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.103315 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:29:36.103374 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.103337 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:29:36.103374 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.103354 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:29:36.103374 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.103362 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:29:36.105587 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.105573 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.105672 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.105596 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:29:36.106239 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.106224 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:29:36.106312 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.106255 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:29:36.106312 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.106283 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:29:36.119577 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.119558 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.129593 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.129578 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-98.ec2.internal\" not found" node="ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.133939 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.133920 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-98.ec2.internal\" not found" node="ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.217573 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.217550 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d08f152a589114ccae524fe85db2c916-config\") pod \"kube-apiserver-proxy-ip-10-0-138-98.ec2.internal\" (UID: \"d08f152a589114ccae524fe85db2c916\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.217573 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.217574 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93abc9bda106257cfd0968536bca0439-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal\" (UID: \"93abc9bda106257cfd0968536bca0439\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.217718 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.217595 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93abc9bda106257cfd0968536bca0439-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal\" (UID: \"93abc9bda106257cfd0968536bca0439\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.220645 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.220631 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.318268 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.318243 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93abc9bda106257cfd0968536bca0439-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal\" (UID: \"93abc9bda106257cfd0968536bca0439\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.318345 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.318270 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93abc9bda106257cfd0968536bca0439-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal\" (UID: \"93abc9bda106257cfd0968536bca0439\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.318345 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.318287 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d08f152a589114ccae524fe85db2c916-config\") pod \"kube-apiserver-proxy-ip-10-0-138-98.ec2.internal\" (UID: \"d08f152a589114ccae524fe85db2c916\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.318426 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.318339 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93abc9bda106257cfd0968536bca0439-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal\" (UID: \"93abc9bda106257cfd0968536bca0439\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.318426 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.318400 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d08f152a589114ccae524fe85db2c916-config\") pod \"kube-apiserver-proxy-ip-10-0-138-98.ec2.internal\" (UID: \"d08f152a589114ccae524fe85db2c916\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.318426 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.318425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93abc9bda106257cfd0968536bca0439-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal\" (UID: \"93abc9bda106257cfd0968536bca0439\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.321341 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.321328 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.422140 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.422070 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.433278 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.433239 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.437659 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.437638 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" Sep 17 18:29:36.522556 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.522533 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.623029 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.623003 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.723542 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.723477 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.801852 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.801824 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:29:36.824406 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:36.824385 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-98.ec2.internal\" not found" Sep 17 18:29:36.864551 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.864529 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 18:29:36.864940 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.864638 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 18:29:36.864940 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.864685 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 18:29:36.921301 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.921130 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:29:36.943215 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.943188 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 18:24:35 +0000 UTC" deadline="2028-03-19 18:22:44.083058993 +0000 UTC" Sep 17 18:29:36.943215 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:36.943213 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13175h53m7.13984928s" Sep 17 18:29:37.015601 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.015530 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" Sep 17 18:29:37.029282 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.029262 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 18:29:37.030199 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.030184 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" Sep 17 18:29:37.042844 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.042827 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 18:29:37.087746 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:37.087721 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08f152a589114ccae524fe85db2c916.slice/crio-1cb792721791007e461659668f9a104d29689a0ce78bcefe1c84f01fc183afde WatchSource:0}: Error finding container 1cb792721791007e461659668f9a104d29689a0ce78bcefe1c84f01fc183afde: Status 404 returned error can't find the container with id 1cb792721791007e461659668f9a104d29689a0ce78bcefe1c84f01fc183afde Sep 17 18:29:37.088028 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:37.088008 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93abc9bda106257cfd0968536bca0439.slice/crio-804b50d6eca7823725c1f4e7e14813eae6badf436faae5fb12b92028b944eed8 WatchSource:0}: Error finding container 804b50d6eca7823725c1f4e7e14813eae6badf436faae5fb12b92028b944eed8: Status 404 returned error can't find the container with id 804b50d6eca7823725c1f4e7e14813eae6badf436faae5fb12b92028b944eed8 Sep 17 18:29:37.094749 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.094726 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:29:37.180883 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.180861 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:29:37.895629 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.895586 2585 apiserver.go:52] "Watching apiserver" Sep 17 18:29:37.903958 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.903931 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 18:29:37.904348 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.904320 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal","openshift-cluster-node-tuning-operator/tuned-r5k59","openshift-image-registry/node-ca-n8lp5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-dp89z","kube-system/global-pull-secret-syncer-8v8g7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz","openshift-dns/node-resolver-gxqb6","openshift-multus/multus-additional-cni-plugins-xvjbw","openshift-multus/multus-qpjtf","openshift-multus/network-metrics-daemon-fqgnw","openshift-network-diagnostics/network-check-target-kd74b","openshift-network-operator/iptables-alerter-4fwvw","kube-system/konnectivity-agent-l2h2v"] Sep 17 18:29:37.907150 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.907120 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.909467 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.909284 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:37.909684 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.909655 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-td6p7\"" Sep 17 18:29:37.909792 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.909775 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 18:29:37.910130 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.909885 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 18:29:37.910130 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.909891 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 18:29:37.910130 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.910009 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 18:29:37.911570 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.911539 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:37.912211 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.911887 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:29:37.912211 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.912071 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 18:29:37.912211 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.912153 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 18:29:37.912211 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.912160 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hrq5n\"" Sep 17 18:29:37.913751 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.913733 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:37.914285 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.914129 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 18:29:37.914285 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.914201 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f6qmj\"" Sep 17 18:29:37.914486 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.914461 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 18:29:37.914766 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.914725 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 18:29:37.915368 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.915353 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 18:29:37.916931 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.916337 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 18:29:37.916931 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.916367 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 18:29:37.916931 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.916607 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hntf5\"" Sep 17 18:29:37.916931 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.916750 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.918665 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.918647 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:37.918847 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:37.918710 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:37.919632 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.919251 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cz4k5\"" Sep 17 18:29:37.919632 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.919261 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 18:29:37.919632 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.919501 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 18:29:37.920833 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.920460 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 18:29:37.920833 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.920592 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 18:29:37.920833 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.920676 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 18:29:37.920833 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.920745 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 18:29:37.921092 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.921076 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:37.924446 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.924386 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nvpw8\"" Sep 17 18:29:37.924532 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.924489 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 18:29:37.924594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.924572 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 18:29:37.925232 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.924896 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4flw9\" (UniqueName: \"kubernetes.io/projected/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-kube-api-access-4flw9\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926216 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-cni-bin\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926240 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-hostroot\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926287 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-host\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-systemd-units\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926334 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-cni-multus\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926357 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-daemon-config\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926399 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-cni-netd\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926433 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926456 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525e9d9c-1072-4eb5-bc02-d36db0353299-konnectivity-ca\") pod \"konnectivity-agent-l2h2v\" (UID: \"525e9d9c-1072-4eb5-bc02-d36db0353299\") " pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926505 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtdxw\" (UniqueName: \"kubernetes.io/projected/b36a38be-b360-412b-83e7-fa7acead01dd-kube-api-access-mtdxw\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926528 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525e9d9c-1072-4eb5-bc02-d36db0353299-agent-certs\") pod \"konnectivity-agent-l2h2v\" (UID: \"525e9d9c-1072-4eb5-bc02-d36db0353299\") " pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926550 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926571 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-node-log\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926591 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-log-socket\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.927077 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926613 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b36a38be-b360-412b-83e7-fa7acead01dd-host-slash\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926634 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-slash\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926656 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-ovnkube-config\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926678 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-cni-binary-copy\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926699 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-netns\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926733 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-multus-certs\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926767 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-etc-kubernetes\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926790 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89kh4\" (UniqueName: \"kubernetes.io/projected/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-kube-api-access-89kh4\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926867 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b36a38be-b360-412b-83e7-fa7acead01dd-iptables-alerter-script\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926898 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-serviceca\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926921 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-run-netns\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926954 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-etc-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.926977 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927073 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-cni-bin\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927094 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-var-lib-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927118 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4667e603-efca-4e0b-b313-47bb8d38085d-ovn-node-metrics-cert\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927139 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qclk8\" (UniqueName: \"kubernetes.io/projected/4667e603-efca-4e0b-b313-47bb8d38085d-kube-api-access-qclk8\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928141 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927172 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-system-cni-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927201 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-cni-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927224 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-conf-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927248 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-ovn\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927281 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-kubelet\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927304 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-kubelet\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927327 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-systemd\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-env-overrides\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927373 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-ovnkube-script-lib\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927399 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-cnibin\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927440 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-socket-dir-parent\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927469 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-k8s-cni-cncf-io\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927763 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.927906 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.928090 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 18:29:37.928905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.928101 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tz82f\"" Sep 17 18:29:37.929667 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.929636 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:37.932114 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.932064 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:37.933065 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.933042 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:29:37.933161 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.933133 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 18:29:37.933454 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.933415 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 18:29:37.933549 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.933491 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-htfv9\"" Sep 17 18:29:37.934570 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.934522 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:37.934657 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:37.934596 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:37.934825 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.934800 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 18:29:37.934898 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.934841 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 18:29:37.935130 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.935110 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-whgvr\"" Sep 17 18:29:37.937066 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.937025 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:37.937267 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:37.937218 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:37.952971 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.952950 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lm94p" Sep 17 18:29:37.960809 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:37.960782 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lm94p" Sep 17 18:29:38.004567 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.004505 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" event={"ID":"d08f152a589114ccae524fe85db2c916","Type":"ContainerStarted","Data":"1cb792721791007e461659668f9a104d29689a0ce78bcefe1c84f01fc183afde"} Sep 17 18:29:38.006184 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.006157 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" event={"ID":"93abc9bda106257cfd0968536bca0439","Type":"ContainerStarted","Data":"804b50d6eca7823725c1f4e7e14813eae6badf436faae5fb12b92028b944eed8"} Sep 17 18:29:38.017448 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.017426 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 18:29:38.027709 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027670 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2knfz\" (UniqueName: \"kubernetes.io/projected/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-kube-api-access-2knfz\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.027832 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-ovn\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.027832 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027759 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3ae15d-0775-4489-a8a9-4723f82c7376-dbus\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.027832 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027784 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-host\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.027832 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027799 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-ovn\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.027832 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027807 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hnzm\" (UniqueName: \"kubernetes.io/projected/1c581c8e-be8f-408b-b322-d4e9ce1e066a-kube-api-access-4hnzm\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.028114 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:38.028114 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.027966 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.028114 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028041 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-systemd\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028114 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028106 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-k8s-cni-cncf-io\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028133 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028171 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-hostroot\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028194 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-run\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028216 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028136 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-systemd\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028242 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-tmp-dir\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028266 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-host\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:38.028296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028171 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-k8s-cni-cncf-io\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028219 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-hostroot\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028305 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-systemd-units\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-cni-multus\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028353 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-host\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028391 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm2ck\" (UniqueName: \"kubernetes.io/projected/823ef570-bbb8-4ddc-b395-4b253bc743d4-kube-api-access-cm2ck\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028414 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-hosts-file\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028438 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-systemd-units\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028478 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028506 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028526 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028532 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-lib-modules\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028576 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-cni-multus\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028564 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-system-cni-dir\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028614 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-registration-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028625 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-run-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.028666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.028663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-ovnkube-config\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029406 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029284 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-ovnkube-config\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029406 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029342 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89kh4\" (UniqueName: \"kubernetes.io/projected/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-kube-api-access-89kh4\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.029406 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029371 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3ae15d-0775-4489-a8a9-4723f82c7376-kubelet-config\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.029406 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029395 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-kubernetes\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.029581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029416 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cnibin\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.029581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029445 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b36a38be-b360-412b-83e7-fa7acead01dd-iptables-alerter-script\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:38.029581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029469 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-serviceca\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:38.029581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-run-netns\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029514 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-etc-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-cni-bin\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029561 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qclk8\" (UniqueName: \"kubernetes.io/projected/4667e603-efca-4e0b-b313-47bb8d38085d-kube-api-access-qclk8\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029585 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-var-lib-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029609 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-system-cni-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029631 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7mvm\" (UniqueName: \"kubernetes.io/projected/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-kube-api-access-j7mvm\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029656 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029682 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-kubelet\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029703 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-sys\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029726 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khbsh\" (UniqueName: \"kubernetes.io/projected/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-kube-api-access-khbsh\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029754 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-kubelet\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029777 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-env-overrides\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029799 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-ovnkube-script-lib\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029827 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-cnibin\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029861 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-socket-dir-parent\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029884 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysconfig\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029908 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4flw9\" (UniqueName: \"kubernetes.io/projected/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-kube-api-access-4flw9\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:38.029934 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029933 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-cni-bin\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029955 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-tuned\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029974 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b36a38be-b360-412b-83e7-fa7acead01dd-iptables-alerter-script\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029977 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-sys-fs\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030048 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-etc-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030088 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-daemon-config\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030109 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysctl-d\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030124 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysctl-conf\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-var-lib-kubelet\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030151 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c581c8e-be8f-408b-b322-d4e9ce1e066a-tmp\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030167 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030193 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-cni-netd\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030227 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525e9d9c-1072-4eb5-bc02-d36db0353299-konnectivity-ca\") pod \"konnectivity-agent-l2h2v\" (UID: \"525e9d9c-1072-4eb5-bc02-d36db0353299\") " pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030244 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtdxw\" (UniqueName: \"kubernetes.io/projected/b36a38be-b360-412b-83e7-fa7acead01dd-kube-api-access-mtdxw\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525e9d9c-1072-4eb5-bc02-d36db0353299-agent-certs\") pod \"konnectivity-agent-l2h2v\" (UID: \"525e9d9c-1072-4eb5-bc02-d36db0353299\") " pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030274 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-node-log\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030287 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-log-socket\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.030639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030304 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-multus-certs\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030318 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030332 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b36a38be-b360-412b-83e7-fa7acead01dd-host-slash\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030346 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-slash\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030348 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-env-overrides\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030376 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-serviceca\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030415 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-system-cni-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030474 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-kubelet\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030480 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-cni-bin\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030361 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-cni-binary-copy\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.029800 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-var-lib-openvswitch\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030494 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4667e603-efca-4e0b-b313-47bb8d38085d-ovnkube-script-lib\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030519 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-netns\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030556 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-etc-kubernetes\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030566 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-kubelet\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030574 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-modprobe-d\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030589 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-systemd\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030600 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-netns\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.031417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030638 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030669 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4667e603-efca-4e0b-b313-47bb8d38085d-ovn-node-metrics-cert\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030695 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-var-lib-cni-bin\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030694 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-conf-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030745 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-daemon-config\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030764 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-cni-netd\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030784 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-run-netns\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030797 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030803 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-etc-kubernetes\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030797 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-conf-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030847 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-host-run-multus-certs\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030883 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-cni-binary-copy\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030889 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-log-socket\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030891 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b36a38be-b360-412b-83e7-fa7acead01dd-host-slash\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030899 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-socket-dir-parent\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030921 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.030952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-socket-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.032297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031004 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-cni-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.033151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031041 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-host-slash\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.033151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031052 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-cnibin\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.033151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031078 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-device-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.033151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031079 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 18:29:38.033151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031116 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4667e603-efca-4e0b-b313-47bb8d38085d-node-log\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.033151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031175 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-multus-cni-dir\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.033151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.031377 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525e9d9c-1072-4eb5-bc02-d36db0353299-konnectivity-ca\") pod \"konnectivity-agent-l2h2v\" (UID: \"525e9d9c-1072-4eb5-bc02-d36db0353299\") " pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:38.035208 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.035187 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4667e603-efca-4e0b-b313-47bb8d38085d-ovn-node-metrics-cert\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.035360 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.035324 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525e9d9c-1072-4eb5-bc02-d36db0353299-agent-certs\") pod \"konnectivity-agent-l2h2v\" (UID: \"525e9d9c-1072-4eb5-bc02-d36db0353299\") " pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:38.044316 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.044247 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4flw9\" (UniqueName: \"kubernetes.io/projected/d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45-kube-api-access-4flw9\") pod \"node-ca-n8lp5\" (UID: \"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45\") " pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:38.045336 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.045306 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89kh4\" (UniqueName: \"kubernetes.io/projected/d1c9edf0-f044-46d6-a1aa-e0a13f309c88-kube-api-access-89kh4\") pod \"multus-qpjtf\" (UID: \"d1c9edf0-f044-46d6-a1aa-e0a13f309c88\") " pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.045779 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.045755 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtdxw\" (UniqueName: \"kubernetes.io/projected/b36a38be-b360-412b-83e7-fa7acead01dd-kube-api-access-mtdxw\") pod \"iptables-alerter-4fwvw\" (UID: \"b36a38be-b360-412b-83e7-fa7acead01dd\") " pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:38.047358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.047336 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qclk8\" (UniqueName: \"kubernetes.io/projected/4667e603-efca-4e0b-b313-47bb8d38085d-kube-api-access-qclk8\") pod \"ovnkube-node-dp89z\" (UID: \"4667e603-efca-4e0b-b313-47bb8d38085d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.132396 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132346 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-host\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.132396 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132391 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hnzm\" (UniqueName: \"kubernetes.io/projected/1c581c8e-be8f-408b-b322-d4e9ce1e066a-kube-api-access-4hnzm\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.132396 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132417 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:38.132396 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132457 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-host\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132464 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132516 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-run\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132543 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.132552 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-tmp-dir\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132595 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm2ck\" (UniqueName: \"kubernetes.io/projected/823ef570-bbb8-4ddc-b395-4b253bc743d4-kube-api-access-cm2ck\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.132637 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret podName:ae3ae15d-0775-4489-a8a9-4723f82c7376 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:38.632604107 +0000 UTC m=+4.569992972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret") pod "global-pull-secret-syncer-8v8g7" (UID: "ae3ae15d-0775-4489-a8a9-4723f82c7376") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132664 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-hosts-file\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132690 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-lib-modules\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132712 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-system-cni-dir\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132738 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-registration-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132763 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3ae15d-0775-4489-a8a9-4723f82c7376-kubelet-config\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132789 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-kubernetes\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.132803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132810 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cnibin\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132846 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7mvm\" (UniqueName: \"kubernetes.io/projected/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-kube-api-access-j7mvm\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132854 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-run\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132875 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132900 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-sys\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khbsh\" (UniqueName: \"kubernetes.io/projected/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-kube-api-access-khbsh\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132948 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysconfig\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.132974 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-tuned\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133072 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-registration-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133370 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-tmp-dir\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.133373 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.133470 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs podName:c57d2d2f-f606-45f4-84bf-0dee13e4adeb nodeName:}" failed. No retries permitted until 2026-09-17 18:29:38.633455348 +0000 UTC m=+4.570844193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs") pod "network-metrics-daemon-fqgnw" (UID: "c57d2d2f-f606-45f4-84bf-0dee13e4adeb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133484 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133516 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-hosts-file\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133605 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-lib-modules\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133668 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-system-cni-dir\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133722 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-kubernetes\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.133877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133761 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cnibin\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133802 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-sys\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.133902 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3ae15d-0775-4489-a8a9-4723f82c7376-kubelet-config\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134183 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysconfig\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134337 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134350 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-sys-fs\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysctl-d\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysctl-conf\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134460 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-var-lib-kubelet\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134481 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c581c8e-be8f-408b-b322-d4e9ce1e066a-tmp\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134503 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134533 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134560 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-modprobe-d\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134583 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-systemd\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134604 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134629 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134651 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysctl-conf\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.134887 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134654 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-socket-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134702 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-device-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134728 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2knfz\" (UniqueName: \"kubernetes.io/projected/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-kube-api-access-2knfz\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134747 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-socket-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3ae15d-0775-4489-a8a9-4723f82c7376-dbus\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134802 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3ae15d-0775-4489-a8a9-4723f82c7376-dbus\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134831 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-var-lib-kubelet\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134857 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-sys-fs\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.134961 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-sysctl-d\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.135028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-device-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.135100 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-modprobe-d\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.135239 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.135279 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/823ef570-bbb8-4ddc-b395-4b253bc743d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.135490 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-systemd\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.135636 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.135815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.135661 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.137087 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.137056 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c581c8e-be8f-408b-b322-d4e9ce1e066a-etc-tuned\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.137259 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.137102 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c581c8e-be8f-408b-b322-d4e9ce1e066a-tmp\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.140737 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.140715 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:29:38.140737 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.140738 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:29:38.140886 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.140751 2585 projected.go:196] Error preparing data for projected volume kube-api-access-l8zt5 for pod openshift-network-diagnostics/network-check-target-kd74b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:38.140886 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.140810 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5 podName:033a0b30-5cad-4f09-8a98-2cc6011f8f14 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:38.64079623 +0000 UTC m=+4.578185078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l8zt5" (UniqueName: "kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5") pod "network-check-target-kd74b" (UID: "033a0b30-5cad-4f09-8a98-2cc6011f8f14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:38.141697 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.141651 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm2ck\" (UniqueName: \"kubernetes.io/projected/823ef570-bbb8-4ddc-b395-4b253bc743d4-kube-api-access-cm2ck\") pod \"aws-ebs-csi-driver-node-lhdmz\" (UID: \"823ef570-bbb8-4ddc-b395-4b253bc743d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.143604 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.143583 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7mvm\" (UniqueName: \"kubernetes.io/projected/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-kube-api-access-j7mvm\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:38.144107 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.144084 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khbsh\" (UniqueName: \"kubernetes.io/projected/7e725bf4-527b-4c77-b6c9-7e9c9d6a169e-kube-api-access-khbsh\") pod \"multus-additional-cni-plugins-xvjbw\" (UID: \"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e\") " pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.144534 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.144509 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hnzm\" (UniqueName: \"kubernetes.io/projected/1c581c8e-be8f-408b-b322-d4e9ce1e066a-kube-api-access-4hnzm\") pod \"tuned-r5k59\" (UID: \"1c581c8e-be8f-408b-b322-d4e9ce1e066a\") " pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.144638 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.144516 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2knfz\" (UniqueName: \"kubernetes.io/projected/03b9acbe-9f26-41a7-83b1-25c1f587cbd0-kube-api-access-2knfz\") pod \"node-resolver-gxqb6\" (UID: \"03b9acbe-9f26-41a7-83b1-25c1f587cbd0\") " pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.220891 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.220815 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpjtf" Sep 17 18:29:38.232625 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.232603 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4fwvw" Sep 17 18:29:38.242424 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.242400 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8lp5" Sep 17 18:29:38.248049 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.248025 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:38.254647 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.254627 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:29:38.262774 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.262743 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" Sep 17 18:29:38.269631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.269615 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" Sep 17 18:29:38.277102 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.277083 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5k59" Sep 17 18:29:38.283591 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.283570 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gxqb6" Sep 17 18:29:38.427853 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.427824 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:29:38.637526 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.637445 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:38.637526 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.637481 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:38.637732 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.637628 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:38.637732 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.637681 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret podName:ae3ae15d-0775-4489-a8a9-4723f82c7376 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:39.63766826 +0000 UTC m=+5.575057118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret") pod "global-pull-secret-syncer-8v8g7" (UID: "ae3ae15d-0775-4489-a8a9-4723f82c7376") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:38.637732 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.637630 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:38.637873 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.637778 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs podName:c57d2d2f-f606-45f4-84bf-0dee13e4adeb nodeName:}" failed. No retries permitted until 2026-09-17 18:29:39.637759218 +0000 UTC m=+5.575148075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs") pod "network-metrics-daemon-fqgnw" (UID: "c57d2d2f-f606-45f4-84bf-0dee13e4adeb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:38.738743 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.738698 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:38.738916 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.738849 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:29:38.738916 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.738872 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:29:38.738916 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.738884 2585 projected.go:196] Error preparing data for projected volume kube-api-access-l8zt5 for pod openshift-network-diagnostics/network-check-target-kd74b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:38.739108 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:38.738946 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5 podName:033a0b30-5cad-4f09-8a98-2cc6011f8f14 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:39.738929669 +0000 UTC m=+5.676318532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8zt5" (UniqueName: "kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5") pod "network-check-target-kd74b" (UID: "033a0b30-5cad-4f09-8a98-2cc6011f8f14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:38.945135 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.945057 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36a38be_b360_412b_83e7_fa7acead01dd.slice/crio-ba8e33c2821f4953a98c1e4ef99f2869c62b79235b39e8dd950c18ac8ceb66ca WatchSource:0}: Error finding container ba8e33c2821f4953a98c1e4ef99f2869c62b79235b39e8dd950c18ac8ceb66ca: Status 404 returned error can't find the container with id ba8e33c2821f4953a98c1e4ef99f2869c62b79235b39e8dd950c18ac8ceb66ca Sep 17 18:29:38.946519 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.946495 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b9acbe_9f26_41a7_83b1_25c1f587cbd0.slice/crio-bad366fbbebba60503610b31a8f978d8d29c102b50e80fd44b926ba6028f3804 WatchSource:0}: Error finding container bad366fbbebba60503610b31a8f978d8d29c102b50e80fd44b926ba6028f3804: Status 404 returned error can't find the container with id bad366fbbebba60503610b31a8f978d8d29c102b50e80fd44b926ba6028f3804 Sep 17 18:29:38.947369 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.947341 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525e9d9c_1072_4eb5_bc02_d36db0353299.slice/crio-6f97daa3c3b2e90dcddbc1dd18200169f8b98d441c096e61c4555b49dd7a1ce9 WatchSource:0}: Error finding container 6f97daa3c3b2e90dcddbc1dd18200169f8b98d441c096e61c4555b49dd7a1ce9: Status 404 returned error can't find the container with id 6f97daa3c3b2e90dcddbc1dd18200169f8b98d441c096e61c4555b49dd7a1ce9 Sep 17 18:29:38.948924 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.948883 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c9edf0_f044_46d6_a1aa_e0a13f309c88.slice/crio-cb173f5c57bb78089a8058b62de7f183ee571a9cd493a22e193c8f3cbdaa1650 WatchSource:0}: Error finding container cb173f5c57bb78089a8058b62de7f183ee571a9cd493a22e193c8f3cbdaa1650: Status 404 returned error can't find the container with id cb173f5c57bb78089a8058b62de7f183ee571a9cd493a22e193c8f3cbdaa1650 Sep 17 18:29:38.951079 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.950849 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e725bf4_527b_4c77_b6c9_7e9c9d6a169e.slice/crio-0d475920980dba70d107e15085e98874c4f7acaed73ca67c123400b9753aa34a WatchSource:0}: Error finding container 0d475920980dba70d107e15085e98874c4f7acaed73ca67c123400b9753aa34a: Status 404 returned error can't find the container with id 0d475920980dba70d107e15085e98874c4f7acaed73ca67c123400b9753aa34a Sep 17 18:29:38.951905 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.951864 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4667e603_efca_4e0b_b313_47bb8d38085d.slice/crio-f35c1c6b7d798d7974576fab49aa5defe1c351a4f00fd990f11e29eb93d4c9a4 WatchSource:0}: Error finding container f35c1c6b7d798d7974576fab49aa5defe1c351a4f00fd990f11e29eb93d4c9a4: Status 404 returned error can't find the container with id f35c1c6b7d798d7974576fab49aa5defe1c351a4f00fd990f11e29eb93d4c9a4 Sep 17 18:29:38.952756 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.952687 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823ef570_bbb8_4ddc_b395_4b253bc743d4.slice/crio-d522a1c058dc91414c5b7ecd5349255ddb4ea458eda3c3357314bc56de5d68b3 WatchSource:0}: Error finding container d522a1c058dc91414c5b7ecd5349255ddb4ea458eda3c3357314bc56de5d68b3: Status 404 returned error can't find the container with id d522a1c058dc91414c5b7ecd5349255ddb4ea458eda3c3357314bc56de5d68b3 Sep 17 18:29:38.953681 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.953660 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c581c8e_be8f_408b_b322_d4e9ce1e066a.slice/crio-8a40d83d913c77b6a6be2071339ef1a42ce838fa881876f0ce364b54dce5b605 WatchSource:0}: Error finding container 8a40d83d913c77b6a6be2071339ef1a42ce838fa881876f0ce364b54dce5b605: Status 404 returned error can't find the container with id 8a40d83d913c77b6a6be2071339ef1a42ce838fa881876f0ce364b54dce5b605 Sep 17 18:29:38.954995 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:29:38.954956 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57b8158_cb69_4f87_a3f1_5d4cfeb2fb45.slice/crio-a7770a29cde90a60554f20134ed28d62d9fdb14b927900495275e3a6e465379d WatchSource:0}: Error finding container a7770a29cde90a60554f20134ed28d62d9fdb14b927900495275e3a6e465379d: Status 404 returned error can't find the container with id a7770a29cde90a60554f20134ed28d62d9fdb14b927900495275e3a6e465379d Sep 17 18:29:38.963870 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.963714 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:24:37 +0000 UTC" deadline="2028-02-13 22:28:11.508755649 +0000 UTC" Sep 17 18:29:38.963870 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:38.963759 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12339h58m32.544999917s" Sep 17 18:29:39.009773 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.009737 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" event={"ID":"823ef570-bbb8-4ddc-b395-4b253bc743d4","Type":"ContainerStarted","Data":"d522a1c058dc91414c5b7ecd5349255ddb4ea458eda3c3357314bc56de5d68b3"} Sep 17 18:29:39.010939 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.010910 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerStarted","Data":"0d475920980dba70d107e15085e98874c4f7acaed73ca67c123400b9753aa34a"} Sep 17 18:29:39.012035 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.012009 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpjtf" event={"ID":"d1c9edf0-f044-46d6-a1aa-e0a13f309c88","Type":"ContainerStarted","Data":"cb173f5c57bb78089a8058b62de7f183ee571a9cd493a22e193c8f3cbdaa1650"} Sep 17 18:29:39.013041 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.013018 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4fwvw" event={"ID":"b36a38be-b360-412b-83e7-fa7acead01dd","Type":"ContainerStarted","Data":"ba8e33c2821f4953a98c1e4ef99f2869c62b79235b39e8dd950c18ac8ceb66ca"} Sep 17 18:29:39.014082 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.014062 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8lp5" event={"ID":"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45","Type":"ContainerStarted","Data":"a7770a29cde90a60554f20134ed28d62d9fdb14b927900495275e3a6e465379d"} Sep 17 18:29:39.015075 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.015056 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5k59" event={"ID":"1c581c8e-be8f-408b-b322-d4e9ce1e066a","Type":"ContainerStarted","Data":"8a40d83d913c77b6a6be2071339ef1a42ce838fa881876f0ce364b54dce5b605"} Sep 17 18:29:39.016096 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.016076 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"f35c1c6b7d798d7974576fab49aa5defe1c351a4f00fd990f11e29eb93d4c9a4"} Sep 17 18:29:39.017175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.017155 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2h2v" event={"ID":"525e9d9c-1072-4eb5-bc02-d36db0353299","Type":"ContainerStarted","Data":"6f97daa3c3b2e90dcddbc1dd18200169f8b98d441c096e61c4555b49dd7a1ce9"} Sep 17 18:29:39.018268 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.018246 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gxqb6" event={"ID":"03b9acbe-9f26-41a7-83b1-25c1f587cbd0","Type":"ContainerStarted","Data":"bad366fbbebba60503610b31a8f978d8d29c102b50e80fd44b926ba6028f3804"} Sep 17 18:29:39.648016 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.647913 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:39.648016 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.647970 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:39.648248 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.648133 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:39.648248 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.648195 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret podName:ae3ae15d-0775-4489-a8a9-4723f82c7376 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:41.648179011 +0000 UTC m=+7.585567860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret") pod "global-pull-secret-syncer-8v8g7" (UID: "ae3ae15d-0775-4489-a8a9-4723f82c7376") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:39.648606 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.648587 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:39.648675 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.648641 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs podName:c57d2d2f-f606-45f4-84bf-0dee13e4adeb nodeName:}" failed. No retries permitted until 2026-09-17 18:29:41.648624665 +0000 UTC m=+7.586013523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs") pod "network-metrics-daemon-fqgnw" (UID: "c57d2d2f-f606-45f4-84bf-0dee13e4adeb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:39.749182 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.749144 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:39.749480 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.749376 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:29:39.749480 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.749403 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:29:39.749480 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.749417 2585 projected.go:196] Error preparing data for projected volume kube-api-access-l8zt5 for pod openshift-network-diagnostics/network-check-target-kd74b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:39.749480 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:39.749479 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5 podName:033a0b30-5cad-4f09-8a98-2cc6011f8f14 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:41.749460989 +0000 UTC m=+7.686849851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8zt5" (UniqueName: "kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5") pod "network-check-target-kd74b" (UID: "033a0b30-5cad-4f09-8a98-2cc6011f8f14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:39.964702 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.964493 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:24:37 +0000 UTC" deadline="2028-03-12 09:05:00.684154794 +0000 UTC" Sep 17 18:29:39.964702 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:39.964532 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12998h35m20.719628122s" Sep 17 18:29:40.003096 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.002272 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:40.003096 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:40.002397 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:40.003096 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.002782 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:40.003096 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:40.002879 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:40.003096 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.002938 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:40.006332 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:40.006274 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:40.044294 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.043519 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" event={"ID":"d08f152a589114ccae524fe85db2c916","Type":"ContainerStarted","Data":"7957109c255682ded7fe37b210bbd8583e301f089b5df25a894c170fa2396913"} Sep 17 18:29:40.069488 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.068968 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:29:40.085009 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.084621 2585 generic.go:356] "Generic (PLEG): container finished" podID="93abc9bda106257cfd0968536bca0439" containerID="51f2aae8d02db7ca66b3ceef7ba1f8774bfd6ddfca23be30c401924bdc6e40f9" exitCode=0 Sep 17 18:29:40.085009 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.084701 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" event={"ID":"93abc9bda106257cfd0968536bca0439","Type":"ContainerDied","Data":"51f2aae8d02db7ca66b3ceef7ba1f8774bfd6ddfca23be30c401924bdc6e40f9"} Sep 17 18:29:40.100350 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:40.099794 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-98.ec2.internal" podStartSLOduration=3.099772908 podStartE2EDuration="3.099772908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:40.0587853 +0000 UTC m=+5.996174169" watchObservedRunningTime="2026-09-17 18:29:40.099772908 +0000 UTC m=+6.037161775" Sep 17 18:29:41.106110 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:41.105378 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" event={"ID":"93abc9bda106257cfd0968536bca0439","Type":"ContainerStarted","Data":"34b30614d286308ef4a1ea4dac7c3bfeacbb25aab916734e5a8b62134a1dc268"} Sep 17 18:29:41.120531 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:41.120287 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-98.ec2.internal" podStartSLOduration=4.120266647 podStartE2EDuration="4.120266647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:41.119313537 +0000 UTC m=+7.056702403" watchObservedRunningTime="2026-09-17 18:29:41.120266647 +0000 UTC m=+7.057655514" Sep 17 18:29:41.665535 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:41.665494 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:41.665716 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:41.665551 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:41.665716 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.665666 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:41.665716 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.665685 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:41.665868 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.665742 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret podName:ae3ae15d-0775-4489-a8a9-4723f82c7376 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:45.665724603 +0000 UTC m=+11.603113453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret") pod "global-pull-secret-syncer-8v8g7" (UID: "ae3ae15d-0775-4489-a8a9-4723f82c7376") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:41.665868 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.665761 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs podName:c57d2d2f-f606-45f4-84bf-0dee13e4adeb nodeName:}" failed. No retries permitted until 2026-09-17 18:29:45.665751186 +0000 UTC m=+11.603140037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs") pod "network-metrics-daemon-fqgnw" (UID: "c57d2d2f-f606-45f4-84bf-0dee13e4adeb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:41.766907 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:41.766867 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:41.767173 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.767080 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:29:41.767173 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.767107 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:29:41.767173 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.767119 2585 projected.go:196] Error preparing data for projected volume kube-api-access-l8zt5 for pod openshift-network-diagnostics/network-check-target-kd74b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:41.767369 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:41.767185 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5 podName:033a0b30-5cad-4f09-8a98-2cc6011f8f14 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:45.76716553 +0000 UTC m=+11.704554380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8zt5" (UniqueName: "kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5") pod "network-check-target-kd74b" (UID: "033a0b30-5cad-4f09-8a98-2cc6011f8f14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:42.001674 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:42.001101 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:42.001674 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:42.001119 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:42.001674 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:42.001101 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:42.001674 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:42.001235 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:42.001674 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:42.001331 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:42.001674 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:42.001417 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:44.000190 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:44.000149 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:44.000190 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:44.000149 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:44.000716 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:44.000296 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:44.000716 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:44.000320 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:44.000716 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:44.000415 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:44.000716 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:44.000485 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:45.702307 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:45.702272 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:45.702824 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:45.702317 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:45.702824 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.702442 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:45.702824 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.702512 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret podName:ae3ae15d-0775-4489-a8a9-4723f82c7376 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:53.702494196 +0000 UTC m=+19.639883058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret") pod "global-pull-secret-syncer-8v8g7" (UID: "ae3ae15d-0775-4489-a8a9-4723f82c7376") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:45.702824 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.702511 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:45.702824 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.702580 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs podName:c57d2d2f-f606-45f4-84bf-0dee13e4adeb nodeName:}" failed. No retries permitted until 2026-09-17 18:29:53.702561179 +0000 UTC m=+19.639950026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs") pod "network-metrics-daemon-fqgnw" (UID: "c57d2d2f-f606-45f4-84bf-0dee13e4adeb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:45.803142 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:45.803107 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:45.803388 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.803355 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:29:45.803461 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.803401 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:29:45.803461 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.803419 2585 projected.go:196] Error preparing data for projected volume kube-api-access-l8zt5 for pod openshift-network-diagnostics/network-check-target-kd74b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:45.803567 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.803483 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5 podName:033a0b30-5cad-4f09-8a98-2cc6011f8f14 nodeName:}" failed. No retries permitted until 2026-09-17 18:29:53.803459459 +0000 UTC m=+19.740848307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8zt5" (UniqueName: "kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5") pod "network-check-target-kd74b" (UID: "033a0b30-5cad-4f09-8a98-2cc6011f8f14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:45.999764 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:45.999695 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:45.999883 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:45.999828 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:46.001568 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:46.001484 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:46.001568 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:46.001478 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:46.001770 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:46.001601 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:46.001770 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:46.001696 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:47.999815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:47.999781 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:48.000290 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:47.999776 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:48.000290 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:47.999905 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:48.000290 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:47.999779 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:48.000290 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:48.000015 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:48.000290 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:48.000101 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:50.000133 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:50.000093 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:50.000655 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:50.000092 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:50.000655 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:50.000239 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:50.000655 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:50.000347 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:50.000655 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:50.000109 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:50.000655 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:50.000485 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:51.999704 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:51.999670 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:51.999704 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:51.999685 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:52.000191 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:51.999687 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:52.000191 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:51.999780 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:52.000191 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:51.999829 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:52.000191 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:51.999908 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:53.764163 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:53.764129 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:53.764163 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:53.764165 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:53.764690 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.764277 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:53.764690 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.764326 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret podName:ae3ae15d-0775-4489-a8a9-4723f82c7376 nodeName:}" failed. No retries permitted until 2026-09-17 18:30:09.764314163 +0000 UTC m=+35.701703007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret") pod "global-pull-secret-syncer-8v8g7" (UID: "ae3ae15d-0775-4489-a8a9-4723f82c7376") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:29:53.764690 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.764277 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:53.764690 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.764398 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs podName:c57d2d2f-f606-45f4-84bf-0dee13e4adeb nodeName:}" failed. No retries permitted until 2026-09-17 18:30:09.764385076 +0000 UTC m=+35.701773930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs") pod "network-metrics-daemon-fqgnw" (UID: "c57d2d2f-f606-45f4-84bf-0dee13e4adeb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:29:53.865370 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:53.865333 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:53.865536 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.865451 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:29:53.865536 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.865478 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:29:53.865536 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.865491 2585 projected.go:196] Error preparing data for projected volume kube-api-access-l8zt5 for pod openshift-network-diagnostics/network-check-target-kd74b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:53.865663 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:53.865551 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5 podName:033a0b30-5cad-4f09-8a98-2cc6011f8f14 nodeName:}" failed. No retries permitted until 2026-09-17 18:30:09.865530499 +0000 UTC m=+35.802919356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8zt5" (UniqueName: "kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5") pod "network-check-target-kd74b" (UID: "033a0b30-5cad-4f09-8a98-2cc6011f8f14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:29:54.000061 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:54.000021 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:54.000212 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:54.000031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:54.000212 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:54.000157 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:54.000212 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:54.000031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:54.000331 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:54.000222 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:54.000331 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:54.000274 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:55.999958 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:55.999923 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:56.000437 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:56.000036 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:56.000437 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:56.000116 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:56.000437 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:56.000210 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:56.000437 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:56.000250 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:56.000437 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:56.000323 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:57.137972 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.137576 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8lp5" event={"ID":"d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45","Type":"ContainerStarted","Data":"3d758593e53bf5b3d7cb5c01f2976684f2f48f97df4b5b60f5a55222855a1484"} Sep 17 18:29:57.139193 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.139169 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5k59" event={"ID":"1c581c8e-be8f-408b-b322-d4e9ce1e066a","Type":"ContainerStarted","Data":"50977881fb6eaca0b740ffa040b8eba198c076a734b02a800b4e06960249bc2d"} Sep 17 18:29:57.142050 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142034 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:29:57.142374 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142356 2585 generic.go:356] "Generic (PLEG): container finished" podID="4667e603-efca-4e0b-b313-47bb8d38085d" containerID="2d96806a51c5bd60832783b17bd831ee70d469f0b161f511e05fc3f302abad29" exitCode=1 Sep 17 18:29:57.142443 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142426 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"69eb05f9a3d001c27767103d804c0e288c406218714a0cc67e78eceb09141dca"} Sep 17 18:29:57.142497 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142483 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"d0a8dd1d935f0a5d56edcd82974c403d9ac158f4965c3122eb4ae9b7d9865ac8"} Sep 17 18:29:57.142542 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142528 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"a0f1cc81380c1676a651421552876ef1105f4bf0a1963929e4f6fa19de5f1d0d"} Sep 17 18:29:57.142576 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142564 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"06e242730a9e506017dce0cd9a3ab6dddc095ed3d6ab74b9265d49323ed45645"} Sep 17 18:29:57.142619 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142605 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerDied","Data":"2d96806a51c5bd60832783b17bd831ee70d469f0b161f511e05fc3f302abad29"} Sep 17 18:29:57.142669 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.142655 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"1b2e8a2f472d928adfe0f638cd602a143491c04fea3420dde7dde77586009b50"} Sep 17 18:29:57.143726 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.143709 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2h2v" event={"ID":"525e9d9c-1072-4eb5-bc02-d36db0353299","Type":"ContainerStarted","Data":"7a8ddd098757e3434daa6a35fc3cc3651fd3db592ac8beb40fd36d379d319bc3"} Sep 17 18:29:57.144886 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.144866 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gxqb6" event={"ID":"03b9acbe-9f26-41a7-83b1-25c1f587cbd0","Type":"ContainerStarted","Data":"0ba5749e25f36eff49896b6f3adbb16002dc6ee0135b5b9638d12c83eec98ff1"} Sep 17 18:29:57.146209 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.146192 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" event={"ID":"823ef570-bbb8-4ddc-b395-4b253bc743d4","Type":"ContainerStarted","Data":"5b83f21930709a210f52b5019f3290124979a87947318b2320fb7d6a761e5402"} Sep 17 18:29:57.147555 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.147535 2585 generic.go:356] "Generic (PLEG): container finished" podID="7e725bf4-527b-4c77-b6c9-7e9c9d6a169e" containerID="7d6b98c79ffc0f815c93ae27e375ac2fb800754fa31231af56c20324fc7733b4" exitCode=0 Sep 17 18:29:57.147641 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.147590 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerDied","Data":"7d6b98c79ffc0f815c93ae27e375ac2fb800754fa31231af56c20324fc7733b4"} Sep 17 18:29:57.149189 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.149171 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpjtf" event={"ID":"d1c9edf0-f044-46d6-a1aa-e0a13f309c88","Type":"ContainerStarted","Data":"8f7e3beaf2f7389beddea67fc8bc9f5bd6174347e8c5dd8107da49ac7ff41ee3"} Sep 17 18:29:57.157501 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.157466 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n8lp5" podStartSLOduration=3.991463908 podStartE2EDuration="21.157454767s" totalImagesPullingTime="17.165990859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:57.157067235 +0000 UTC m=+23.094456102" watchObservedRunningTime="2026-09-17 18:29:57.157454767 +0000 UTC m=+23.094843632" Sep 17 18:29:57.176346 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.176312 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpjtf" podStartSLOduration=3.963613773 podStartE2EDuration="21.176300104s" totalImagesPullingTime="17.212686331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:57.174887709 +0000 UTC m=+23.112276575" watchObservedRunningTime="2026-09-17 18:29:57.176300104 +0000 UTC m=+23.113688971" Sep 17 18:29:57.214561 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.214515 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gxqb6" podStartSLOduration=4.11350192 podStartE2EDuration="21.214496367s" totalImagesPullingTime="17.100994447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:57.211476747 +0000 UTC m=+23.148865607" watchObservedRunningTime="2026-09-17 18:29:57.214496367 +0000 UTC m=+23.151885233" Sep 17 18:29:57.227720 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.227690 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l2h2v" podStartSLOduration=4.127873627 podStartE2EDuration="21.227678502s" totalImagesPullingTime="17.099804875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:57.227380779 +0000 UTC m=+23.164769647" watchObservedRunningTime="2026-09-17 18:29:57.227678502 +0000 UTC m=+23.165067368" Sep 17 18:29:57.244978 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.244942 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r5k59" podStartSLOduration=4.076246249 podStartE2EDuration="21.244931021s" totalImagesPullingTime="17.168684772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:57.244739746 +0000 UTC m=+23.182128609" watchObservedRunningTime="2026-09-17 18:29:57.244931021 +0000 UTC m=+23.182319884" Sep 17 18:29:57.472650 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:57.472617 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 18:29:58.000104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.000065 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:58.000280 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:58.000189 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:58.000280 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.000070 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:58.000398 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:58.000305 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:58.000677 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.000517 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:58.000677 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:58.000639 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:29:58.000963 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.000873 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T18:29:57.472646547Z","UUID":"88bfb5cf-f95b-4aab-a989-abcbd1412633","Handler":null,"Name":"","Endpoint":""} Sep 17 18:29:58.002881 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.002862 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 18:29:58.003011 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.002897 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 18:29:58.154801 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.154692 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" event={"ID":"823ef570-bbb8-4ddc-b395-4b253bc743d4","Type":"ContainerStarted","Data":"9177e5ec0a06c7ece2602d46834b65a777c1aec4c9978850d72691337a291b25"} Sep 17 18:29:58.156615 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.156582 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4fwvw" event={"ID":"b36a38be-b360-412b-83e7-fa7acead01dd","Type":"ContainerStarted","Data":"edfb70571653202cadbf50a33e7530719b9f41f53999ae52a06b34463e1830b5"} Sep 17 18:29:58.174277 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.174237 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4fwvw" podStartSLOduration=4.9972098240000005 podStartE2EDuration="22.174223286s" totalImagesPullingTime="17.177013462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:58.174098137 +0000 UTC m=+24.111487006" watchObservedRunningTime="2026-09-17 18:29:58.174223286 +0000 UTC m=+24.111612151" Sep 17 18:29:58.267398 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.267363 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:58.268031 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:58.268008 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:29:59.163453 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:59.163427 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:29:59.163911 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:59.163883 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"fb5138cdc164ab4947e0377f64342e5cf54d5945366f27cd720516bba8663485"} Sep 17 18:29:59.166168 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:59.166143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" event={"ID":"823ef570-bbb8-4ddc-b395-4b253bc743d4","Type":"ContainerStarted","Data":"670f9103fb694af1af23d8d0423c2801f90bbf60110c38ecf07236694386951c"} Sep 17 18:29:59.190482 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:59.190407 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhdmz" podStartSLOduration=4.159002974 podStartE2EDuration="23.190382559s" totalImagesPullingTime="19.031379585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:29:59.189365376 +0000 UTC m=+25.126754239" watchObservedRunningTime="2026-09-17 18:29:59.190382559 +0000 UTC m=+25.127771420" Sep 17 18:29:59.999617 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:59.999581 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:29:59.999772 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:59.999581 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:29:59.999772 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:59.999697 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:29:59.999772 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:29:59.999587 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:29:59.999922 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:59.999789 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:29:59.999922 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:29:59.999848 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:30:00.168369 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:00.168343 2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 18:30:02.000189 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.000019 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:02.000905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.000034 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:02.000905 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:02.000258 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:30:02.000905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.000059 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:02.000905 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:02.000357 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:30:02.000905 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:02.000437 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:30:02.175412 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.175383 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:30:02.175799 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.175767 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"d5e0dff106f5f4581c0821f9e01a362b764c5f89ba975b9a60c942ce5a5e8619"} Sep 17 18:30:02.176074 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.176054 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:30:02.176247 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.176233 2585 scope.go:117] "RemoveContainer" containerID="2d96806a51c5bd60832783b17bd831ee70d469f0b161f511e05fc3f302abad29" Sep 17 18:30:02.177782 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.177759 2585 generic.go:356] "Generic (PLEG): container finished" podID="7e725bf4-527b-4c77-b6c9-7e9c9d6a169e" containerID="250edee53dab78a127c05be6fa18aaff9cbb551eff72dafbd148d9cb04fc8e16" exitCode=0 Sep 17 18:30:02.177864 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.177798 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerDied","Data":"250edee53dab78a127c05be6fa18aaff9cbb551eff72dafbd148d9cb04fc8e16"} Sep 17 18:30:02.192084 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:02.192066 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:30:03.185162 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.184917 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:30:03.185646 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.185615 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" event={"ID":"4667e603-efca-4e0b-b313-47bb8d38085d","Type":"ContainerStarted","Data":"550ad373987b2c7f823e21bf8a5c444fbb2099be901957cf6e8b57d16e9118e6"} Sep 17 18:30:03.185775 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.185739 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8v8g7"] Sep 17 18:30:03.185958 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.185935 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:03.185958 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.185950 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:30:03.186134 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:03.186074 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:30:03.186187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.186139 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:30:03.190905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.190879 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fqgnw"] Sep 17 18:30:03.191087 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.191028 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:03.191163 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:03.191145 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:30:03.192045 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.192023 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kd74b"] Sep 17 18:30:03.192132 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.192109 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:03.192194 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:03.192177 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:30:03.203582 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.203558 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:30:03.218176 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:03.218127 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" podStartSLOduration=9.758915993 podStartE2EDuration="27.218109907s" totalImagesPullingTime="17.459193914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:03.217255303 +0000 UTC m=+29.154644183" watchObservedRunningTime="2026-09-17 18:30:03.218109907 +0000 UTC m=+29.155498770" Sep 17 18:30:04.192880 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:04.192797 2585 generic.go:356] "Generic (PLEG): container finished" podID="7e725bf4-527b-4c77-b6c9-7e9c9d6a169e" containerID="7d03f9846bff25dd3bfb1130904dc5da418fe60f7cd8f0dc056a4f3b2c3d680d" exitCode=0 Sep 17 18:30:04.192880 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:04.192851 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerDied","Data":"7d03f9846bff25dd3bfb1130904dc5da418fe60f7cd8f0dc056a4f3b2c3d680d"} Sep 17 18:30:04.999773 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:04.999738 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:04.999773 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:04.999767 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:05.000045 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:04.999776 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:05.000045 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:04.999865 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:30:05.000045 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:04.999977 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:30:05.000193 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:05.000067 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:30:06.167379 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:06.167336 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:30:06.167811 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:06.167466 2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 18:30:06.168005 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:06.167962 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l2h2v" Sep 17 18:30:06.199248 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:06.199219 2585 generic.go:356] "Generic (PLEG): container finished" podID="7e725bf4-527b-4c77-b6c9-7e9c9d6a169e" containerID="50693dc0ae7bdf4257e1f7ec77f5da30a4cd0de6707fcd29e11d369674e301a2" exitCode=0 Sep 17 18:30:06.199392 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:06.199297 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerDied","Data":"50693dc0ae7bdf4257e1f7ec77f5da30a4cd0de6707fcd29e11d369674e301a2"} Sep 17 18:30:07.000030 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:06.999992 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:07.000217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:07.000114 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:07.000217 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:07.000127 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:30:07.000217 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:07.000145 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:07.000374 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:07.000248 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:30:07.000427 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:07.000365 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:30:08.999743 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:08.999707 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:08.999743 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:08.999734 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:09.000335 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:08.999802 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:09.000335 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:08.999816 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd74b" podUID="033a0b30-5cad-4f09-8a98-2cc6011f8f14" Sep 17 18:30:09.000335 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:08.999915 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqgnw" podUID="c57d2d2f-f606-45f4-84bf-0dee13e4adeb" Sep 17 18:30:09.000335 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.000006 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8v8g7" podUID="ae3ae15d-0775-4489-a8a9-4723f82c7376" Sep 17 18:30:09.771771 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:09.771730 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:09.771771 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:09.771777 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:09.772102 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.771910 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:30:09.772102 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.771915 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:30:09.772102 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.771996 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret podName:ae3ae15d-0775-4489-a8a9-4723f82c7376 nodeName:}" failed. No retries permitted until 2026-09-17 18:30:41.771959581 +0000 UTC m=+67.709348448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret") pod "global-pull-secret-syncer-8v8g7" (UID: "ae3ae15d-0775-4489-a8a9-4723f82c7376") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:30:09.772102 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.772018 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs podName:c57d2d2f-f606-45f4-84bf-0dee13e4adeb nodeName:}" failed. No retries permitted until 2026-09-17 18:30:41.772007718 +0000 UTC m=+67.709396562 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs") pod "network-metrics-daemon-fqgnw" (UID: "c57d2d2f-f606-45f4-84bf-0dee13e4adeb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:30:09.873195 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:09.873163 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:09.873381 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.873291 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:30:09.873381 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.873313 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:30:09.873381 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.873327 2585 projected.go:196] Error preparing data for projected volume kube-api-access-l8zt5 for pod openshift-network-diagnostics/network-check-target-kd74b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:30:09.873548 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:09.873383 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5 podName:033a0b30-5cad-4f09-8a98-2cc6011f8f14 nodeName:}" failed. No retries permitted until 2026-09-17 18:30:41.873370201 +0000 UTC m=+67.810759045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8zt5" (UniqueName: "kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5") pod "network-check-target-kd74b" (UID: "033a0b30-5cad-4f09-8a98-2cc6011f8f14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:30:09.982029 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:09.981998 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-98.ec2.internal" event="NodeReady" Sep 17 18:30:09.982279 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:09.982156 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 18:30:10.831732 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:10.831711 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gxqb6_03b9acbe-9f26-41a7-83b1-25c1f587cbd0/dns-node-resolver/0.log" Sep 17 18:30:10.999803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:10.999716 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:10.999803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:10.999717 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:11.000058 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:10.999721 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:11.014176 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.014158 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 18:30:11.015495 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.015473 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 18:30:11.015586 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.015518 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-twvp2\"" Sep 17 18:30:11.015586 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.015550 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-58cdj\"" Sep 17 18:30:11.015682 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.015655 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 18:30:11.015854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.015835 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 18:30:11.214746 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.214714 2585 generic.go:356] "Generic (PLEG): container finished" podID="7e725bf4-527b-4c77-b6c9-7e9c9d6a169e" containerID="32b6672395ae0e6ca0d2092e9c29c311f406fc08cf1d5a6ed9aa7dad1e617fee" exitCode=0 Sep 17 18:30:11.214895 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.214775 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerDied","Data":"32b6672395ae0e6ca0d2092e9c29c311f406fc08cf1d5a6ed9aa7dad1e617fee"} Sep 17 18:30:11.993625 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:11.993601 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8lp5_d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45/node-ca/0.log" Sep 17 18:30:12.220398 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:12.220368 2585 generic.go:356] "Generic (PLEG): container finished" podID="7e725bf4-527b-4c77-b6c9-7e9c9d6a169e" containerID="7b6cad17477665a46098c0b5bcc03068730707a6ff98d3b7081f334e099a7050" exitCode=0 Sep 17 18:30:12.220545 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:12.220412 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerDied","Data":"7b6cad17477665a46098c0b5bcc03068730707a6ff98d3b7081f334e099a7050"} Sep 17 18:30:13.226186 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:13.226156 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" event={"ID":"7e725bf4-527b-4c77-b6c9-7e9c9d6a169e","Type":"ContainerStarted","Data":"84d799a4587d2fc5d9c985e2eb2572e9a2437dfa34e00c8355f538d4e5bc7153"} Sep 17 18:30:13.258599 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:13.258549 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xvjbw" podStartSLOduration=8.578053998 podStartE2EDuration="37.258530833s" totalImagesPullingTime="28.680476835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:13.25697229 +0000 UTC m=+39.194361165" watchObservedRunningTime="2026-09-17 18:30:13.258530833 +0000 UTC m=+39.195919698" Sep 17 18:30:30.007875 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.007846 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b7798b895-6pcq9"] Sep 17 18:30:30.055701 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.055669 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7798b895-6pcq9"] Sep 17 18:30:30.055850 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.055779 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.058629 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.058607 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 18:30:30.058763 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.058613 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 18:30:30.059000 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.058957 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pndxg\"" Sep 17 18:30:30.060226 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.060211 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 18:30:30.067161 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.067144 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 18:30:30.101805 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.101783 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-69mlq"] Sep 17 18:30:30.115507 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115486 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f52cc90c-e13d-4999-99da-552a0c3902bc-trusted-ca\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.115601 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115519 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-bound-sa-token\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.115601 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115548 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f52cc90c-e13d-4999-99da-552a0c3902bc-registry-certificates\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.115601 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115570 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f52cc90c-e13d-4999-99da-552a0c3902bc-installation-pull-secrets\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.115697 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115641 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f52cc90c-e13d-4999-99da-552a0c3902bc-image-registry-private-configuration\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.115697 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115664 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7htpz\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-kube-api-access-7htpz\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.115697 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115689 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-registry-tls\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.115786 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.115733 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f52cc90c-e13d-4999-99da-552a0c3902bc-ca-trust-extracted\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.127165 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.127145 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4w846"] Sep 17 18:30:30.127275 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.127260 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.132335 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.132314 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 18:30:30.132426 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.132314 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 18:30:30.132426 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.132362 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cvvrd\"" Sep 17 18:30:30.149819 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.149795 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-69mlq"] Sep 17 18:30:30.149922 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.149826 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4w846"] Sep 17 18:30:30.149922 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.149841 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zrxvn"] Sep 17 18:30:30.150056 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.149926 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.152673 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.152656 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 18:30:30.152768 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.152673 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 18:30:30.152768 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.152708 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7c6q4\"" Sep 17 18:30:30.152877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.152781 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 18:30:30.173877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.173855 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zrxvn"] Sep 17 18:30:30.174020 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.173999 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.176524 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.176503 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 18:30:30.177782 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.177764 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 18:30:30.177782 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.177771 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h9v8g\"" Sep 17 18:30:30.178762 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.178715 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 18:30:30.178859 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.178822 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 18:30:30.216893 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.216870 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f52cc90c-e13d-4999-99da-552a0c3902bc-installation-pull-secrets\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217032 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.216899 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7lt\" (UniqueName: \"kubernetes.io/projected/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-kube-api-access-5b7lt\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.217032 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.216921 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xxc\" (UniqueName: \"kubernetes.io/projected/1f2f41dc-f6ba-4c88-9918-63f61c14248d-kube-api-access-c6xxc\") pod \"ingress-canary-4w846\" (UID: \"1f2f41dc-f6ba-4c88-9918-63f61c14248d\") " pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.217032 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.216942 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7zbl\" (UniqueName: \"kubernetes.io/projected/4cb04374-96b9-4622-af35-7456553fe8e4-kube-api-access-c7zbl\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.217189 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217030 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f52cc90c-e13d-4999-99da-552a0c3902bc-image-registry-private-configuration\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217189 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217079 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7htpz\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-kube-api-access-7htpz\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217189 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217178 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cb04374-96b9-4622-af35-7456553fe8e4-metrics-tls\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.217345 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217330 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-registry-tls\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217408 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217389 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cb04374-96b9-4622-af35-7456553fe8e4-config-volume\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.217460 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217428 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f52cc90c-e13d-4999-99da-552a0c3902bc-ca-trust-extracted\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217541 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217527 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f41dc-f6ba-4c88-9918-63f61c14248d-cert\") pod \"ingress-canary-4w846\" (UID: \"1f2f41dc-f6ba-4c88-9918-63f61c14248d\") " pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.217597 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217563 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-data-volume\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.217648 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217593 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f52cc90c-e13d-4999-99da-552a0c3902bc-trusted-ca\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217648 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217616 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cb04374-96b9-4622-af35-7456553fe8e4-tmp-dir\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.217749 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217658 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-bound-sa-token\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217749 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217682 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-crio-socket\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.217749 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217716 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.217749 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217740 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.217938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217779 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f52cc90c-e13d-4999-99da-552a0c3902bc-registry-certificates\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.217938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.217782 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f52cc90c-e13d-4999-99da-552a0c3902bc-ca-trust-extracted\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.218491 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.218472 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f52cc90c-e13d-4999-99da-552a0c3902bc-registry-certificates\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.218591 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.218567 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f52cc90c-e13d-4999-99da-552a0c3902bc-trusted-ca\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.220769 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.220745 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f52cc90c-e13d-4999-99da-552a0c3902bc-installation-pull-secrets\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.220844 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.220780 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f52cc90c-e13d-4999-99da-552a0c3902bc-image-registry-private-configuration\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.220881 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.220846 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-registry-tls\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.228909 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.228890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7htpz\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-kube-api-access-7htpz\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.231290 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.231271 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f52cc90c-e13d-4999-99da-552a0c3902bc-bound-sa-token\") pod \"image-registry-b7798b895-6pcq9\" (UID: \"f52cc90c-e13d-4999-99da-552a0c3902bc\") " pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.318378 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318346 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cb04374-96b9-4622-af35-7456553fe8e4-metrics-tls\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.318562 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318401 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cb04374-96b9-4622-af35-7456553fe8e4-config-volume\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.318562 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318509 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f41dc-f6ba-4c88-9918-63f61c14248d-cert\") pod \"ingress-canary-4w846\" (UID: \"1f2f41dc-f6ba-4c88-9918-63f61c14248d\") " pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.318562 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-data-volume\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.318717 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cb04374-96b9-4622-af35-7456553fe8e4-tmp-dir\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.318717 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318593 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-crio-socket\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.318717 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318641 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.318717 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318671 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.318717 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318700 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7lt\" (UniqueName: \"kubernetes.io/projected/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-kube-api-access-5b7lt\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.318969 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318729 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xxc\" (UniqueName: \"kubernetes.io/projected/1f2f41dc-f6ba-4c88-9918-63f61c14248d-kube-api-access-c6xxc\") pod \"ingress-canary-4w846\" (UID: \"1f2f41dc-f6ba-4c88-9918-63f61c14248d\") " pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.318969 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318751 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7zbl\" (UniqueName: \"kubernetes.io/projected/4cb04374-96b9-4622-af35-7456553fe8e4-kube-api-access-c7zbl\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.318969 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318838 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-crio-socket\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.318969 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.318926 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-data-volume\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.319250 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.319182 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cb04374-96b9-4622-af35-7456553fe8e4-config-volume\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.319304 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.319263 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.319494 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.319478 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cb04374-96b9-4622-af35-7456553fe8e4-tmp-dir\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.320839 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.320820 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cb04374-96b9-4622-af35-7456553fe8e4-metrics-tls\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.320970 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.320948 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.321149 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.321133 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f2f41dc-f6ba-4c88-9918-63f61c14248d-cert\") pod \"ingress-canary-4w846\" (UID: \"1f2f41dc-f6ba-4c88-9918-63f61c14248d\") " pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.327205 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.327175 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7lt\" (UniqueName: \"kubernetes.io/projected/edf6a230-cfb9-4503-9c2d-dd0884fb44ec-kube-api-access-5b7lt\") pod \"insights-runtime-extractor-zrxvn\" (UID: \"edf6a230-cfb9-4503-9c2d-dd0884fb44ec\") " pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.327883 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.327862 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7zbl\" (UniqueName: \"kubernetes.io/projected/4cb04374-96b9-4622-af35-7456553fe8e4-kube-api-access-c7zbl\") pod \"dns-default-69mlq\" (UID: \"4cb04374-96b9-4622-af35-7456553fe8e4\") " pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.327978 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.327958 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xxc\" (UniqueName: \"kubernetes.io/projected/1f2f41dc-f6ba-4c88-9918-63f61c14248d-kube-api-access-c6xxc\") pod \"ingress-canary-4w846\" (UID: \"1f2f41dc-f6ba-4c88-9918-63f61c14248d\") " pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.364410 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.364373 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:30.435768 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.435727 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:30.457490 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.457470 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4w846" Sep 17 18:30:30.483381 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.483127 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zrxvn" Sep 17 18:30:30.766592 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.766567 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7798b895-6pcq9"] Sep 17 18:30:30.767581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.767557 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-69mlq"] Sep 17 18:30:30.768171 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:30.768149 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb04374_96b9_4622_af35_7456553fe8e4.slice/crio-ccf001d9aa8d333e25ca4e2f040485252810dcd65445890e8c02e967676ee5f9 WatchSource:0}: Error finding container ccf001d9aa8d333e25ca4e2f040485252810dcd65445890e8c02e967676ee5f9: Status 404 returned error can't find the container with id ccf001d9aa8d333e25ca4e2f040485252810dcd65445890e8c02e967676ee5f9 Sep 17 18:30:30.770523 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:30.768771 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52cc90c_e13d_4999_99da_552a0c3902bc.slice/crio-ceb9dec9b17266327050b5bc2654e1e98613ef7da0f041f8f190e70a06a689c4 WatchSource:0}: Error finding container ceb9dec9b17266327050b5bc2654e1e98613ef7da0f041f8f190e70a06a689c4: Status 404 returned error can't find the container with id ceb9dec9b17266327050b5bc2654e1e98613ef7da0f041f8f190e70a06a689c4 Sep 17 18:30:30.779281 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.779261 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4w846"] Sep 17 18:30:30.781923 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:30.781901 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2f41dc_f6ba_4c88_9918_63f61c14248d.slice/crio-ca1c9ff0c6df837f24564797451856220e69a068775ec7c85ee522b4adbfcfa4 WatchSource:0}: Error finding container ca1c9ff0c6df837f24564797451856220e69a068775ec7c85ee522b4adbfcfa4: Status 404 returned error can't find the container with id ca1c9ff0c6df837f24564797451856220e69a068775ec7c85ee522b4adbfcfa4 Sep 17 18:30:30.808905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:30.808868 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zrxvn"] Sep 17 18:30:30.811883 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:30.811861 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf6a230_cfb9_4503_9c2d_dd0884fb44ec.slice/crio-174e261b6fa647d964fc2765b7947628324b02fc2b5cceece1608b22d2fd7949 WatchSource:0}: Error finding container 174e261b6fa647d964fc2765b7947628324b02fc2b5cceece1608b22d2fd7949: Status 404 returned error can't find the container with id 174e261b6fa647d964fc2765b7947628324b02fc2b5cceece1608b22d2fd7949 Sep 17 18:30:31.271948 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.271910 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrxvn" event={"ID":"edf6a230-cfb9-4503-9c2d-dd0884fb44ec","Type":"ContainerStarted","Data":"5f93ca9e2015c7a42fe060807e82051d304f912aae570619fa4241b989d525e5"} Sep 17 18:30:31.272415 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.272011 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrxvn" event={"ID":"edf6a230-cfb9-4503-9c2d-dd0884fb44ec","Type":"ContainerStarted","Data":"174e261b6fa647d964fc2765b7947628324b02fc2b5cceece1608b22d2fd7949"} Sep 17 18:30:31.275084 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.275054 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" event={"ID":"f52cc90c-e13d-4999-99da-552a0c3902bc","Type":"ContainerStarted","Data":"a40d754987f81b2fd78dd1a91c20b8eaec1b3dcf22178a2fc4d38d1b5665f4fc"} Sep 17 18:30:31.275213 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.275104 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" event={"ID":"f52cc90c-e13d-4999-99da-552a0c3902bc","Type":"ContainerStarted","Data":"ceb9dec9b17266327050b5bc2654e1e98613ef7da0f041f8f190e70a06a689c4"} Sep 17 18:30:31.275759 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.275741 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:31.277392 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.277361 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-69mlq" event={"ID":"4cb04374-96b9-4622-af35-7456553fe8e4","Type":"ContainerStarted","Data":"ccf001d9aa8d333e25ca4e2f040485252810dcd65445890e8c02e967676ee5f9"} Sep 17 18:30:31.278996 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.278956 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4w846" event={"ID":"1f2f41dc-f6ba-4c88-9918-63f61c14248d","Type":"ContainerStarted","Data":"ca1c9ff0c6df837f24564797451856220e69a068775ec7c85ee522b4adbfcfa4"} Sep 17 18:30:31.302461 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:31.302396 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" podStartSLOduration=2.302375664 podStartE2EDuration="2.302375664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:31.300876238 +0000 UTC m=+57.238265104" watchObservedRunningTime="2026-09-17 18:30:31.302375664 +0000 UTC m=+57.239764529" Sep 17 18:30:33.290310 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:33.289686 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4w846" event={"ID":"1f2f41dc-f6ba-4c88-9918-63f61c14248d","Type":"ContainerStarted","Data":"508a9c5a2754e3dc60bf74f83a3461d6409dc582a8dee8a0e9eca18a20e26385"} Sep 17 18:30:33.292906 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:33.292839 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrxvn" event={"ID":"edf6a230-cfb9-4503-9c2d-dd0884fb44ec","Type":"ContainerStarted","Data":"49c738b932c7588402779c25ba145ba31a617a4e39d71eeed5eac86f5f765af5"} Sep 17 18:30:33.295780 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:33.295720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-69mlq" event={"ID":"4cb04374-96b9-4622-af35-7456553fe8e4","Type":"ContainerStarted","Data":"d214cee9b6f5e46b1d6a5b58ba0a05008c5821f7e8bbdc2ae2dc157f81166b94"} Sep 17 18:30:33.312038 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:33.311994 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4w846" podStartSLOduration=0.917945262 podStartE2EDuration="3.311961467s" totalImagesPullingTime="2.394016205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:33.31021766 +0000 UTC m=+59.247606528" watchObservedRunningTime="2026-09-17 18:30:33.311961467 +0000 UTC m=+59.249350336" Sep 17 18:30:34.301319 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:34.301278 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-69mlq" event={"ID":"4cb04374-96b9-4622-af35-7456553fe8e4","Type":"ContainerStarted","Data":"c1f8f77e79d79846184c645b4eaf4f4b05a4c0d7e6493857bd2ab3863edcb801"} Sep 17 18:30:34.330741 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:34.330685 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-69mlq" podStartSLOduration=1.92690215 podStartE2EDuration="4.330666199s" totalImagesPullingTime="2.403764049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:34.329715491 +0000 UTC m=+60.267104357" watchObservedRunningTime="2026-09-17 18:30:34.330666199 +0000 UTC m=+60.268055065" Sep 17 18:30:35.206384 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:35.206359 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dp89z" Sep 17 18:30:35.306852 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:35.306811 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrxvn" event={"ID":"edf6a230-cfb9-4503-9c2d-dd0884fb44ec","Type":"ContainerStarted","Data":"15a24d86eee956bac20ce1a2319291c6bf9daa36f668e8defe6ba04533e1934e"} Sep 17 18:30:35.307263 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:35.307038 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:35.329907 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:35.329865 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zrxvn" podStartSLOduration=1.66610834 podStartE2EDuration="5.329851189s" totalImagesPullingTime="3.663742849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:30:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:35.328313803 +0000 UTC m=+61.265702668" watchObservedRunningTime="2026-09-17 18:30:35.329851189 +0000 UTC m=+61.267240054" Sep 17 18:30:37.334000 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.333958 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9fdb94f4-tgjq7"] Sep 17 18:30:37.337886 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.337871 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.341062 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.341016 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 18:30:37.341298 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.341282 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 18:30:37.341298 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.341290 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7v7fk\"" Sep 17 18:30:37.341524 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.341512 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 18:30:37.343961 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.343922 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 18:30:37.343961 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.343955 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 18:30:37.344136 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.343924 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 18:30:37.344136 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.343928 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 18:30:37.349866 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.349847 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9fdb94f4-tgjq7"] Sep 17 18:30:37.374780 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.374759 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-oauth-config\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.374869 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.374795 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-console-config\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.374869 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.374817 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-service-ca\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.374938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.374879 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-serving-cert\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.374938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.374913 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-oauth-serving-cert\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.375025 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.374946 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr44h\" (UniqueName: \"kubernetes.io/projected/81f54d08-288b-40df-ad49-1faab8726fae-kube-api-access-pr44h\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.475639 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.475614 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-oauth-config\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.475729 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.475649 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-console-config\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.475729 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.475665 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-service-ca\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.475827 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.475791 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-serving-cert\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.475827 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.475817 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-oauth-serving-cert\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.475920 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.475847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr44h\" (UniqueName: \"kubernetes.io/projected/81f54d08-288b-40df-ad49-1faab8726fae-kube-api-access-pr44h\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.476425 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.476403 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-console-config\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.476511 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.476429 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-service-ca\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.476511 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.476429 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-oauth-serving-cert\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.478127 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.478101 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-oauth-config\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.478211 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.478149 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-serving-cert\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.484506 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.484483 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr44h\" (UniqueName: \"kubernetes.io/projected/81f54d08-288b-40df-ad49-1faab8726fae-kube-api-access-pr44h\") pod \"console-7f9fdb94f4-tgjq7\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.647203 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.647127 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:37.915637 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:37.915573 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9fdb94f4-tgjq7"] Sep 17 18:30:37.918072 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:37.918047 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f54d08_288b_40df_ad49_1faab8726fae.slice/crio-e78b2bd55d61f4df28d145443a347ee0f2f80a792f63481cf65b95a4ee81a6c2 WatchSource:0}: Error finding container e78b2bd55d61f4df28d145443a347ee0f2f80a792f63481cf65b95a4ee81a6c2: Status 404 returned error can't find the container with id e78b2bd55d61f4df28d145443a347ee0f2f80a792f63481cf65b95a4ee81a6c2 Sep 17 18:30:38.319023 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:38.318933 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9fdb94f4-tgjq7" event={"ID":"81f54d08-288b-40df-ad49-1faab8726fae","Type":"ContainerStarted","Data":"e78b2bd55d61f4df28d145443a347ee0f2f80a792f63481cf65b95a4ee81a6c2"} Sep 17 18:30:39.261793 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.261762 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8"] Sep 17 18:30:39.269907 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.269882 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:39.272794 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.272746 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 18:30:39.274149 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.273966 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jv4ds\"" Sep 17 18:30:39.275185 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.275165 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8"] Sep 17 18:30:39.290103 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.290077 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d0f58e-9937-4a19-aee0-3c038581ebfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fmzg8\" (UID: \"d8d0f58e-9937-4a19-aee0-3c038581ebfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:39.390830 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.390788 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d0f58e-9937-4a19-aee0-3c038581ebfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fmzg8\" (UID: \"d8d0f58e-9937-4a19-aee0-3c038581ebfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:39.391037 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:39.390976 2585 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 18:30:39.391112 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:39.391072 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d0f58e-9937-4a19-aee0-3c038581ebfb-tls-certificates podName:d8d0f58e-9937-4a19-aee0-3c038581ebfb nodeName:}" failed. No retries permitted until 2026-09-17 18:30:39.891053685 +0000 UTC m=+65.828442533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d8d0f58e-9937-4a19-aee0-3c038581ebfb-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" (UID: "d8d0f58e-9937-4a19-aee0-3c038581ebfb") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 18:30:39.896588 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.896561 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d0f58e-9937-4a19-aee0-3c038581ebfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fmzg8\" (UID: \"d8d0f58e-9937-4a19-aee0-3c038581ebfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:39.899208 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:39.899182 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d0f58e-9937-4a19-aee0-3c038581ebfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fmzg8\" (UID: \"d8d0f58e-9937-4a19-aee0-3c038581ebfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:40.182321 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:40.182225 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:41.790495 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.790472 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8"] Sep 17 18:30:41.792741 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:41.792712 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d0f58e_9937_4a19_aee0_3c038581ebfb.slice/crio-7d9a42aca5fda592c89d62eaa5c9a717c2b247f60e950eba9f614ec34250e127 WatchSource:0}: Error finding container 7d9a42aca5fda592c89d62eaa5c9a717c2b247f60e950eba9f614ec34250e127: Status 404 returned error can't find the container with id 7d9a42aca5fda592c89d62eaa5c9a717c2b247f60e950eba9f614ec34250e127 Sep 17 18:30:41.813502 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.813480 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:41.813581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.813510 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:41.816411 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.816395 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 18:30:41.817515 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.817500 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 18:30:41.825901 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.825871 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae15d-0775-4489-a8a9-4723f82c7376-original-pull-secret\") pod \"global-pull-secret-syncer-8v8g7\" (UID: \"ae3ae15d-0775-4489-a8a9-4723f82c7376\") " pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:41.825901 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.825893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57d2d2f-f606-45f4-84bf-0dee13e4adeb-metrics-certs\") pod \"network-metrics-daemon-fqgnw\" (UID: \"c57d2d2f-f606-45f4-84bf-0dee13e4adeb\") " pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:41.913954 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.913924 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8v8g7" Sep 17 18:30:41.914072 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.914054 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:41.916866 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.916853 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 18:30:41.920921 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.920905 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-twvp2\"" Sep 17 18:30:41.927365 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.927352 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 18:30:41.929285 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.929268 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqgnw" Sep 17 18:30:41.937309 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:41.937291 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8zt5\" (UniqueName: \"kubernetes.io/projected/033a0b30-5cad-4f09-8a98-2cc6011f8f14-kube-api-access-l8zt5\") pod \"network-check-target-kd74b\" (UID: \"033a0b30-5cad-4f09-8a98-2cc6011f8f14\") " pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:42.181791 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.181705 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8v8g7"] Sep 17 18:30:42.184970 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:42.184945 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3ae15d_0775_4489_a8a9_4723f82c7376.slice/crio-c33ac21970fe678cfb4aca517cb969d2017939f7610daeb56e1ee8ad446a4427 WatchSource:0}: Error finding container c33ac21970fe678cfb4aca517cb969d2017939f7610daeb56e1ee8ad446a4427: Status 404 returned error can't find the container with id c33ac21970fe678cfb4aca517cb969d2017939f7610daeb56e1ee8ad446a4427 Sep 17 18:30:42.199511 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.199492 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fqgnw"] Sep 17 18:30:42.201462 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:42.201437 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57d2d2f_f606_45f4_84bf_0dee13e4adeb.slice/crio-56c6af0f2a1327763e4bc23e2d86b7d8ca20bed1e077730f0506bf5b555c868d WatchSource:0}: Error finding container 56c6af0f2a1327763e4bc23e2d86b7d8ca20bed1e077730f0506bf5b555c868d: Status 404 returned error can't find the container with id 56c6af0f2a1327763e4bc23e2d86b7d8ca20bed1e077730f0506bf5b555c868d Sep 17 18:30:42.211181 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.211164 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-58cdj\"" Sep 17 18:30:42.219459 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.219443 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:42.335477 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.335414 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9fdb94f4-tgjq7" event={"ID":"81f54d08-288b-40df-ad49-1faab8726fae","Type":"ContainerStarted","Data":"ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0"} Sep 17 18:30:42.336734 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.336708 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8v8g7" event={"ID":"ae3ae15d-0775-4489-a8a9-4723f82c7376","Type":"ContainerStarted","Data":"c33ac21970fe678cfb4aca517cb969d2017939f7610daeb56e1ee8ad446a4427"} Sep 17 18:30:42.338091 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.338064 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" event={"ID":"d8d0f58e-9937-4a19-aee0-3c038581ebfb","Type":"ContainerStarted","Data":"7d9a42aca5fda592c89d62eaa5c9a717c2b247f60e950eba9f614ec34250e127"} Sep 17 18:30:42.339374 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.339341 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqgnw" event={"ID":"c57d2d2f-f606-45f4-84bf-0dee13e4adeb","Type":"ContainerStarted","Data":"56c6af0f2a1327763e4bc23e2d86b7d8ca20bed1e077730f0506bf5b555c868d"} Sep 17 18:30:42.357707 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.357658 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f9fdb94f4-tgjq7" podStartSLOduration=1.6889850819999999 podStartE2EDuration="5.357637352s" totalImagesPullingTime="3.66865227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:42.356571474 +0000 UTC m=+68.293960339" watchObservedRunningTime="2026-09-17 18:30:42.357637352 +0000 UTC m=+68.295026219" Sep 17 18:30:42.505254 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:42.505226 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kd74b"] Sep 17 18:30:42.744191 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:42.744155 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033a0b30_5cad_4f09_8a98_2cc6011f8f14.slice/crio-79ad09c04876bcb81c25eb1539dee7fc36c56fcb3ad913a6b5854a285a4a48be WatchSource:0}: Error finding container 79ad09c04876bcb81c25eb1539dee7fc36c56fcb3ad913a6b5854a285a4a48be: Status 404 returned error can't find the container with id 79ad09c04876bcb81c25eb1539dee7fc36c56fcb3ad913a6b5854a285a4a48be Sep 17 18:30:43.345355 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:43.345314 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kd74b" event={"ID":"033a0b30-5cad-4f09-8a98-2cc6011f8f14","Type":"ContainerStarted","Data":"79ad09c04876bcb81c25eb1539dee7fc36c56fcb3ad913a6b5854a285a4a48be"} Sep 17 18:30:43.349170 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:43.349073 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" event={"ID":"d8d0f58e-9937-4a19-aee0-3c038581ebfb","Type":"ContainerStarted","Data":"61bade9b35dadb516c758bc63b3025dc0c06f99b81635354ce2b8b1aa8f8cf6f"} Sep 17 18:30:43.349170 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:43.349132 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:43.356406 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:43.356386 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" Sep 17 18:30:43.371243 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:43.371196 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fmzg8" podStartSLOduration=3.379353678 podStartE2EDuration="4.37117904s" totalImagesPullingTime="991.825362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:43.370178657 +0000 UTC m=+69.307567525" watchObservedRunningTime="2026-09-17 18:30:43.37117904 +0000 UTC m=+69.308567926" Sep 17 18:30:44.354724 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.354692 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh"] Sep 17 18:30:44.358436 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.357878 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqgnw" event={"ID":"c57d2d2f-f606-45f4-84bf-0dee13e4adeb","Type":"ContainerStarted","Data":"c4ca22fd0b15d49c08d1857dd6fdd1f4ad38076df0cb1db2b2d25c33743f1fea"} Sep 17 18:30:44.358436 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.357920 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqgnw" event={"ID":"c57d2d2f-f606-45f4-84bf-0dee13e4adeb","Type":"ContainerStarted","Data":"f49f80796024584ca6021107602b7e37dd92ec7c8c9d25a74be1b52ef1409326"} Sep 17 18:30:44.358436 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.358023 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.364497 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.364465 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 18:30:44.364696 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.364648 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jkm8x\"" Sep 17 18:30:44.364696 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.364689 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 18:30:44.364842 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.364736 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 18:30:44.364842 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.364694 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 18:30:44.366761 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.366742 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 18:30:44.377097 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.377072 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh"] Sep 17 18:30:44.402045 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.398602 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fqgnw" podStartSLOduration=67.148602702 podStartE2EDuration="1m8.398582393s" totalImagesPullingTime="1.249979691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:44.394960491 +0000 UTC m=+70.332349358" watchObservedRunningTime="2026-09-17 18:30:44.398582393 +0000 UTC m=+70.335971260" Sep 17 18:30:44.435877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.435842 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52aef56a-4b06-433e-9ab6-50f49ebfecc8-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.435877 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.435875 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52aef56a-4b06-433e-9ab6-50f49ebfecc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.436064 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.435926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cp6\" (UniqueName: \"kubernetes.io/projected/52aef56a-4b06-433e-9ab6-50f49ebfecc8-kube-api-access-84cp6\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.436064 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.435952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/52aef56a-4b06-433e-9ab6-50f49ebfecc8-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.537770 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.537274 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/52aef56a-4b06-433e-9ab6-50f49ebfecc8-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.537770 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.537318 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52aef56a-4b06-433e-9ab6-50f49ebfecc8-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.537770 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.537400 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52aef56a-4b06-433e-9ab6-50f49ebfecc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.537770 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.537452 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84cp6\" (UniqueName: \"kubernetes.io/projected/52aef56a-4b06-433e-9ab6-50f49ebfecc8-kube-api-access-84cp6\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.538296 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.538235 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52aef56a-4b06-433e-9ab6-50f49ebfecc8-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.540731 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.540483 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/52aef56a-4b06-433e-9ab6-50f49ebfecc8-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.540731 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.540631 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52aef56a-4b06-433e-9ab6-50f49ebfecc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.548753 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.548711 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cp6\" (UniqueName: \"kubernetes.io/projected/52aef56a-4b06-433e-9ab6-50f49ebfecc8-kube-api-access-84cp6\") pod \"prometheus-operator-7bd5d56d6-rhrxh\" (UID: \"52aef56a-4b06-433e-9ab6-50f49ebfecc8\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.669439 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.669364 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" Sep 17 18:30:44.695682 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.695640 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65bbd79f8-w42mw"] Sep 17 18:30:44.698746 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.698724 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.708777 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.708568 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 18:30:44.715823 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.715801 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bbd79f8-w42mw"] Sep 17 18:30:44.738878 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.738855 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-trusted-ca-bundle\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.739004 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.738891 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbth\" (UniqueName: \"kubernetes.io/projected/0108aa41-5a76-4aba-85d0-b24b8e8de408-kube-api-access-gzbth\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.739004 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.738934 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-serving-cert\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.739173 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.739020 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-config\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.739173 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.739055 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-service-ca\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.739173 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.739082 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-oauth-serving-cert\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.739173 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.739128 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-oauth-config\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.840253 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.840219 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-oauth-config\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.840432 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.840278 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-trusted-ca-bundle\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.840432 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.840310 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbth\" (UniqueName: \"kubernetes.io/projected/0108aa41-5a76-4aba-85d0-b24b8e8de408-kube-api-access-gzbth\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.840432 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.840345 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-serving-cert\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.840432 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.840377 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-config\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.840432 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.840403 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-service-ca\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.840432 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.840428 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-oauth-serving-cert\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.841718 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.841417 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-oauth-serving-cert\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.841718 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.841444 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-config\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.841718 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.841617 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-trusted-ca-bundle\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.842084 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.842061 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-service-ca\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.843367 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.843327 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-oauth-config\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.843997 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.843956 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-serving-cert\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:44.852771 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:44.852744 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbth\" (UniqueName: \"kubernetes.io/projected/0108aa41-5a76-4aba-85d0-b24b8e8de408-kube-api-access-gzbth\") pod \"console-65bbd79f8-w42mw\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:45.012136 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:45.012056 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:45.312116 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:45.312081 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-69mlq" Sep 17 18:30:47.280094 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.279963 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bbd79f8-w42mw"] Sep 17 18:30:47.282805 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.282772 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh"] Sep 17 18:30:47.284728 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:47.284689 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0108aa41_5a76_4aba_85d0_b24b8e8de408.slice/crio-1c8734ffeddf2e96c47733641270c77d72bd57cfb96370b0baaaf7ce9fdc3a58 WatchSource:0}: Error finding container 1c8734ffeddf2e96c47733641270c77d72bd57cfb96370b0baaaf7ce9fdc3a58: Status 404 returned error can't find the container with id 1c8734ffeddf2e96c47733641270c77d72bd57cfb96370b0baaaf7ce9fdc3a58 Sep 17 18:30:47.287186 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:47.287163 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52aef56a_4b06_433e_9ab6_50f49ebfecc8.slice/crio-6b98aaba774204dbc5231a00da2b4ded8a26a7da409cbb72eb3b68db91a5ddbd WatchSource:0}: Error finding container 6b98aaba774204dbc5231a00da2b4ded8a26a7da409cbb72eb3b68db91a5ddbd: Status 404 returned error can't find the container with id 6b98aaba774204dbc5231a00da2b4ded8a26a7da409cbb72eb3b68db91a5ddbd Sep 17 18:30:47.371367 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.371325 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8v8g7" event={"ID":"ae3ae15d-0775-4489-a8a9-4723f82c7376","Type":"ContainerStarted","Data":"dfc072fe7cbe10344d0ba76f6d124e6e1384d058e12066047a055afb05318e47"} Sep 17 18:30:47.373061 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.373031 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbd79f8-w42mw" event={"ID":"0108aa41-5a76-4aba-85d0-b24b8e8de408","Type":"ContainerStarted","Data":"0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268"} Sep 17 18:30:47.373187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.373074 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbd79f8-w42mw" event={"ID":"0108aa41-5a76-4aba-85d0-b24b8e8de408","Type":"ContainerStarted","Data":"1c8734ffeddf2e96c47733641270c77d72bd57cfb96370b0baaaf7ce9fdc3a58"} Sep 17 18:30:47.374698 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.374668 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kd74b" event={"ID":"033a0b30-5cad-4f09-8a98-2cc6011f8f14","Type":"ContainerStarted","Data":"b132edd896ae8a02e73b402af4cf2fe52a7cbbcfeeee7416fa63a28b5cdbe6ec"} Sep 17 18:30:47.374835 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.374731 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:30:47.375937 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.375898 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" event={"ID":"52aef56a-4b06-433e-9ab6-50f49ebfecc8","Type":"ContainerStarted","Data":"6b98aaba774204dbc5231a00da2b4ded8a26a7da409cbb72eb3b68db91a5ddbd"} Sep 17 18:30:47.388573 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.388533 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8v8g7" podStartSLOduration=66.564450453 podStartE2EDuration="1m11.388519607s" totalImagesPullingTime="4.824069154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:47.387938847 +0000 UTC m=+73.325327714" watchObservedRunningTime="2026-09-17 18:30:47.388519607 +0000 UTC m=+73.325908464" Sep 17 18:30:47.410360 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.410299 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65bbd79f8-w42mw" podStartSLOduration=3.4102788840000002 podStartE2EDuration="3.410278884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:47.409152194 +0000 UTC m=+73.346541051" watchObservedRunningTime="2026-09-17 18:30:47.410278884 +0000 UTC m=+73.347667753" Sep 17 18:30:47.426960 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.426906 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kd74b" podStartSLOduration=67.176448656 podStartE2EDuration="1m11.426890172s" totalImagesPullingTime="4.250441516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:47.42562546 +0000 UTC m=+73.363014327" watchObservedRunningTime="2026-09-17 18:30:47.426890172 +0000 UTC m=+73.364279037" Sep 17 18:30:47.647233 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.647208 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:47.647388 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.647264 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:47.651788 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:47.651768 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:48.384480 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:48.384453 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:30:49.385459 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:49.385422 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" event={"ID":"52aef56a-4b06-433e-9ab6-50f49ebfecc8","Type":"ContainerStarted","Data":"16f81095c4070b90e0ffeda1e1645b55862e683a06f8cf56613b3e09fd10c773"} Sep 17 18:30:49.385805 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:49.385483 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" event={"ID":"52aef56a-4b06-433e-9ab6-50f49ebfecc8","Type":"ContainerStarted","Data":"81f5eabe0ad2dd08f197ccc77e8f08ff80503b2443760462defac9521fa1ff78"} Sep 17 18:30:49.409297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:49.409258 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-rhrxh" podStartSLOduration=3.834585933 podStartE2EDuration="5.409242488s" totalImagesPullingTime="1.574656555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:49.407958645 +0000 UTC m=+75.345347510" watchObservedRunningTime="2026-09-17 18:30:49.409242488 +0000 UTC m=+75.346631353" Sep 17 18:30:50.369023 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:50.368965 2585 patch_prober.go:28] interesting pod/image-registry-b7798b895-6pcq9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 18:30:50.369203 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:50.369043 2585 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" podUID="f52cc90c-e13d-4999-99da-552a0c3902bc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 18:30:51.762883 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.762853 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-5v6xf"] Sep 17 18:30:51.765968 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.765952 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.768499 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.768468 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 18:30:51.768602 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.768561 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-76p88\"" Sep 17 18:30:51.771107 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.771090 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 18:30:51.776165 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.776148 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 18:30:51.782187 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.782166 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t"] Sep 17 18:30:51.785256 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.785229 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-5v6xf"] Sep 17 18:30:51.785363 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.785337 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.788967 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.788951 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ndzcx\"" Sep 17 18:30:51.789205 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.789187 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 18:30:51.789257 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.789189 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 18:30:51.805551 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.805525 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t"] Sep 17 18:30:51.833106 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.833066 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m79fk"] Sep 17 18:30:51.836136 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.836121 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.838932 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.838912 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 18:30:51.839050 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.838969 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kwtnd\"" Sep 17 18:30:51.839050 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.839020 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 18:30:51.839050 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.839036 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 18:30:51.891313 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891289 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-sys\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891424 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891321 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-metrics-client-ca\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891424 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891341 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/33820ecb-420a-4aab-891f-1817764ea623-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.891424 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891357 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-textfile\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891441 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891470 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.891594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891503 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-root\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891542 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-wtmp\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891564 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-tls\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891591 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891617 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33820ecb-420a-4aab-891f-1817764ea623-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891645 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891676 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891692 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvmb4\" (UniqueName: \"kubernetes.io/projected/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-kube-api-access-bvmb4\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891716 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-accelerators-collector-config\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891737 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4t2k\" (UniqueName: \"kubernetes.io/projected/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-kube-api-access-g4t2k\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrxw\" (UniqueName: \"kubernetes.io/projected/33820ecb-420a-4aab-891f-1817764ea623-kube-api-access-jhrxw\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891773 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.891884 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.891802 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.992350 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33820ecb-420a-4aab-891f-1817764ea623-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.992439 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992352 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.992439 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992374 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.992439 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992391 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvmb4\" (UniqueName: \"kubernetes.io/projected/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-kube-api-access-bvmb4\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.992594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-accelerators-collector-config\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.992594 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992571 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4t2k\" (UniqueName: \"kubernetes.io/projected/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-kube-api-access-g4t2k\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.992694 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992596 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrxw\" (UniqueName: \"kubernetes.io/projected/33820ecb-420a-4aab-891f-1817764ea623-kube-api-access-jhrxw\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.992694 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992632 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.992694 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992659 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.992836 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:51.992746 2585 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 17 18:30:51.992836 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992780 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-sys\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.992836 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:51.992801 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-tls podName:8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42 nodeName:}" failed. No retries permitted until 2026-09-17 18:30:52.49278174 +0000 UTC m=+78.430170599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-hgr9t" (UID: "8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42") : secret "openshift-state-metrics-tls" not found Sep 17 18:30:51.992836 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992831 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-sys\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992838 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-metrics-client-ca\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/33820ecb-420a-4aab-891f-1817764ea623-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.993079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992906 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-textfile\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992948 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.992975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.993079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993054 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-root\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993082 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-wtmp\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993112 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-tls\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993135 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993181 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33820ecb-420a-4aab-891f-1817764ea623-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993230 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:51.993255 2585 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993295 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/33820ecb-420a-4aab-891f-1817764ea623-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993338 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-accelerators-collector-config\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993358 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:30:51.993352 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-tls podName:33820ecb-420a-4aab-891f-1817764ea623 nodeName:}" failed. No retries permitted until 2026-09-17 18:30:52.49333587 +0000 UTC m=+78.430724721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-5v6xf" (UID: "33820ecb-420a-4aab-891f-1817764ea623") : secret "kube-state-metrics-tls" not found Sep 17 18:30:51.993706 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993423 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-metrics-client-ca\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993706 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993428 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-wtmp\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993706 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993466 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-root\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993706 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993484 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-textfile\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.993898 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.993852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.994972 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.994947 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:51.995619 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.995593 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-tls\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:51.995619 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.995609 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:51.995731 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:51.995679 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:52.005910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.005892 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrxw\" (UniqueName: \"kubernetes.io/projected/33820ecb-420a-4aab-891f-1817764ea623-kube-api-access-jhrxw\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:52.006006 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.005890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvmb4\" (UniqueName: \"kubernetes.io/projected/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-kube-api-access-bvmb4\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:52.007098 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.007080 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4t2k\" (UniqueName: \"kubernetes.io/projected/ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078-kube-api-access-g4t2k\") pod \"node-exporter-m79fk\" (UID: \"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078\") " pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:52.143651 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.143615 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m79fk" Sep 17 18:30:52.154652 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:52.154623 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffaaf873_8fea_47bf_a6eb_5c7f7bfb2078.slice/crio-790bef507c681c5d19f0b33821c5c2636f4b5bf30af2557bdf97f2d23537cd9d WatchSource:0}: Error finding container 790bef507c681c5d19f0b33821c5c2636f4b5bf30af2557bdf97f2d23537cd9d: Status 404 returned error can't find the container with id 790bef507c681c5d19f0b33821c5c2636f4b5bf30af2557bdf97f2d23537cd9d Sep 17 18:30:52.397495 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.397414 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m79fk" event={"ID":"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078","Type":"ContainerStarted","Data":"790bef507c681c5d19f0b33821c5c2636f4b5bf30af2557bdf97f2d23537cd9d"} Sep 17 18:30:52.497795 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.497761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:52.497962 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.497832 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:52.500119 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.500094 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hgr9t\" (UID: \"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:52.500231 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.500214 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33820ecb-420a-4aab-891f-1817764ea623-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-5v6xf\" (UID: \"33820ecb-420a-4aab-891f-1817764ea623\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:52.674414 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.674333 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" Sep 17 18:30:52.693499 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.693474 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" Sep 17 18:30:52.858637 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.858595 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 18:30:52.867273 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.867245 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:52.875832 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.875804 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 18:30:52.876073 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.875840 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 18:30:52.876175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.875905 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 18:30:52.876175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.875951 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 18:30:52.876175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.876129 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 18:30:52.876175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.876064 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 18:30:52.876362 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.876079 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 18:30:52.876544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.876526 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 18:30:52.876629 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.876544 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 18:30:52.876629 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.876612 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tvnww\"" Sep 17 18:30:52.886787 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.886763 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 18:30:52.959675 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.959592 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-5v6xf"] Sep 17 18:30:52.984742 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:52.984674 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t"] Sep 17 18:30:53.005754 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.005725 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-web-config\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.005892 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.005759 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.005892 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.005791 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006032 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.005903 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006032 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.005964 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006032 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006013 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006149 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006046 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006149 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006075 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-config-out\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006149 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006126 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-875bw\" (UniqueName: \"kubernetes.io/projected/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-kube-api-access-875bw\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006287 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006155 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006287 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006177 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006287 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006251 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.006398 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.006290 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.106929 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.106896 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.106942 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107008 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107237 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107165 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107237 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107241 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107269 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-config-out\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-875bw\" (UniqueName: \"kubernetes.io/projected/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-kube-api-access-875bw\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107326 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107359 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107410 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107437 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107472 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-web-config\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.107577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.107535 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.108525 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.108456 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.108856 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.108800 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.110166 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.110142 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.110297 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.110276 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-config-out\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.111476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.111236 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.111476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.111340 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.111476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.111357 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.111841 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.111596 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.112151 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.112126 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.112250 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.112200 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-web-config\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.112681 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.112664 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.116722 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.116697 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-875bw\" (UniqueName: \"kubernetes.io/projected/0fd6d2c6-efee-425c-8d11-2d62a3aacd0b-kube-api-access-875bw\") pod \"alertmanager-main-0\" (UID: \"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.136086 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:53.136062 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33820ecb_420a_4aab_891f_1817764ea623.slice/crio-68b4e46d34cae808d2985dacadffcdc722a7ec781b85b2a55fbc1d8aea2c94df WatchSource:0}: Error finding container 68b4e46d34cae808d2985dacadffcdc722a7ec781b85b2a55fbc1d8aea2c94df: Status 404 returned error can't find the container with id 68b4e46d34cae808d2985dacadffcdc722a7ec781b85b2a55fbc1d8aea2c94df Sep 17 18:30:53.136950 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:53.136929 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6f3e59_5754_41b7_9fb8_ec66fdbaeb42.slice/crio-f1b14828e545b887bf5ee4e0b24ed23fdc5b5545d4f8f3d7638cac8140433acf WatchSource:0}: Error finding container f1b14828e545b887bf5ee4e0b24ed23fdc5b5545d4f8f3d7638cac8140433acf: Status 404 returned error can't find the container with id f1b14828e545b887bf5ee4e0b24ed23fdc5b5545d4f8f3d7638cac8140433acf Sep 17 18:30:53.178649 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.178625 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 18:30:53.302154 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.302053 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b7798b895-6pcq9" Sep 17 18:30:53.402735 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.402702 2585 generic.go:356] "Generic (PLEG): container finished" podID="ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078" containerID="472dd6e4de52fe4e796e47b4842f1ddd5639e763ce511e53982026f778a06431" exitCode=0 Sep 17 18:30:53.402898 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.402792 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m79fk" event={"ID":"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078","Type":"ContainerDied","Data":"472dd6e4de52fe4e796e47b4842f1ddd5639e763ce511e53982026f778a06431"} Sep 17 18:30:53.404036 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.404005 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" event={"ID":"33820ecb-420a-4aab-891f-1817764ea623","Type":"ContainerStarted","Data":"68b4e46d34cae808d2985dacadffcdc722a7ec781b85b2a55fbc1d8aea2c94df"} Sep 17 18:30:53.405943 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.405914 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" event={"ID":"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42","Type":"ContainerStarted","Data":"159080f8d1b7757b2c5158647a3f370b3638be7a9921922c3bcd97fe80031e96"} Sep 17 18:30:53.406072 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.405968 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" event={"ID":"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42","Type":"ContainerStarted","Data":"a6f4ae7654ba0a9d92d8a11f0a5e4df41735c98a4681f289a67faa81bb2f0ac2"} Sep 17 18:30:53.406072 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.406014 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" event={"ID":"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42","Type":"ContainerStarted","Data":"f1b14828e545b887bf5ee4e0b24ed23fdc5b5545d4f8f3d7638cac8140433acf"} Sep 17 18:30:53.473262 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.473238 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 18:30:53.475065 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:53.475040 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd6d2c6_efee_425c_8d11_2d62a3aacd0b.slice/crio-bc0d107120835c67e07bdf3ed1c73bc833364c233525d7fa410024150c941ce5 WatchSource:0}: Error finding container bc0d107120835c67e07bdf3ed1c73bc833364c233525d7fa410024150c941ce5: Status 404 returned error can't find the container with id bc0d107120835c67e07bdf3ed1c73bc833364c233525d7fa410024150c941ce5 Sep 17 18:30:53.779518 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.779435 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bcbd54f68-4nptl"] Sep 17 18:30:53.783375 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.783355 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.786282 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.786260 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 18:30:53.786392 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.786318 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 18:30:53.786600 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.786580 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 18:30:53.786771 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.786740 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 18:30:53.786922 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.786868 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cimdp1afvsd2a\"" Sep 17 18:30:53.786922 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.786877 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 18:30:53.787733 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.787714 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lm4xh\"" Sep 17 18:30:53.803933 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.803913 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bcbd54f68-4nptl"] Sep 17 18:30:53.914706 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.914665 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.915146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.914711 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n76l\" (UniqueName: \"kubernetes.io/projected/712083db-a68f-46b7-acb2-6d3a61b91b05-kube-api-access-8n76l\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.915146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.914761 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/712083db-a68f-46b7-acb2-6d3a61b91b05-metrics-client-ca\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.915146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.914859 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-grpc-tls\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.915146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.914891 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.915146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.914929 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.915146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.914962 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:53.915146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:53.915009 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-tls\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015470 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015432 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/712083db-a68f-46b7-acb2-6d3a61b91b05-metrics-client-ca\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015617 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015500 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-grpc-tls\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015617 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015535 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015617 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015573 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015617 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015839 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015644 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-tls\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015839 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015688 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.015839 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.015709 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n76l\" (UniqueName: \"kubernetes.io/projected/712083db-a68f-46b7-acb2-6d3a61b91b05-kube-api-access-8n76l\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.016848 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.016824 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/712083db-a68f-46b7-acb2-6d3a61b91b05-metrics-client-ca\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.028435 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.021247 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.028435 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.021844 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.028435 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.022247 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-grpc-tls\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.028435 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.022399 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-tls\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.028435 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.024823 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.028435 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.027196 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n76l\" (UniqueName: \"kubernetes.io/projected/712083db-a68f-46b7-acb2-6d3a61b91b05-kube-api-access-8n76l\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.028813 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.028787 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/712083db-a68f-46b7-acb2-6d3a61b91b05-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcbd54f68-4nptl\" (UID: \"712083db-a68f-46b7-acb2-6d3a61b91b05\") " pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.094021 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.093967 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:54.411009 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.410892 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerStarted","Data":"bc0d107120835c67e07bdf3ed1c73bc833364c233525d7fa410024150c941ce5"} Sep 17 18:30:54.413540 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.413514 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m79fk" event={"ID":"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078","Type":"ContainerStarted","Data":"d5cd486df5e01bdc6c47b352f82a91c62df098211885c6cf5f3210bdb3cb358c"} Sep 17 18:30:54.413641 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.413563 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m79fk" event={"ID":"ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078","Type":"ContainerStarted","Data":"a9ff04dbec3dfe40c92fde50175eac90b8b2d2888dd038a4de2d887d3f2d53f0"} Sep 17 18:30:54.435264 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:54.435215 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m79fk" podStartSLOduration=2.344974597 podStartE2EDuration="3.435196514s" totalImagesPullingTime="1.029750023s" totalInitContainerRuntime="60.471894ms" isStatefulPod=true podCreationTimestamp="2026-09-17 18:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:54.433474141 +0000 UTC m=+80.370863008" watchObservedRunningTime="2026-09-17 18:30:54.435196514 +0000 UTC m=+80.372585370" Sep 17 18:30:55.012334 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.012305 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:55.012725 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.012607 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:55.017686 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.017667 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:55.037465 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.037429 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bcbd54f68-4nptl"] Sep 17 18:30:55.041901 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:55.041854 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712083db_a68f_46b7_acb2_6d3a61b91b05.slice/crio-c1b939e2ea352995b0e9d4f7882438d495d18c6242599f589397e8cdbc2c2687 WatchSource:0}: Error finding container c1b939e2ea352995b0e9d4f7882438d495d18c6242599f589397e8cdbc2c2687: Status 404 returned error can't find the container with id c1b939e2ea352995b0e9d4f7882438d495d18c6242599f589397e8cdbc2c2687 Sep 17 18:30:55.421593 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.421550 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" event={"ID":"33820ecb-420a-4aab-891f-1817764ea623","Type":"ContainerStarted","Data":"677464f9ebd1060a14b4aab5c620d401cc15deb604e9ec58dbf504bfeb370b78"} Sep 17 18:30:55.421759 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.421623 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" event={"ID":"33820ecb-420a-4aab-891f-1817764ea623","Type":"ContainerStarted","Data":"091baa88399c1fc77fae299e2c4570eb1514c0776281936599198c85f53b1f11"} Sep 17 18:30:55.421759 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.421652 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" event={"ID":"33820ecb-420a-4aab-891f-1817764ea623","Type":"ContainerStarted","Data":"fedba807d9f3d01457143eec67f1b44d3797dfe108198f8f7dc3ac3d94223312"} Sep 17 18:30:55.424031 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.423999 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" event={"ID":"8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42","Type":"ContainerStarted","Data":"e3ae6960232ac430c555f4131b85b9ac51df0a721671e7926170f3efcbb1a6f3"} Sep 17 18:30:55.425791 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.425761 2585 generic.go:356] "Generic (PLEG): container finished" podID="0fd6d2c6-efee-425c-8d11-2d62a3aacd0b" containerID="0e0da8650ff5856d311b2fa766b64582bf78fb4844285209394957ddf8f36e3e" exitCode=0 Sep 17 18:30:55.425905 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.425842 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerDied","Data":"0e0da8650ff5856d311b2fa766b64582bf78fb4844285209394957ddf8f36e3e"} Sep 17 18:30:55.427429 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.427404 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" event={"ID":"712083db-a68f-46b7-acb2-6d3a61b91b05","Type":"ContainerStarted","Data":"c1b939e2ea352995b0e9d4f7882438d495d18c6242599f589397e8cdbc2c2687"} Sep 17 18:30:55.431631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.431611 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:30:55.449249 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.449202 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-5v6xf" podStartSLOduration=2.828872765 podStartE2EDuration="4.449185372s" totalImagesPullingTime="1.620312607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:55.449099801 +0000 UTC m=+81.386488667" watchObservedRunningTime="2026-09-17 18:30:55.449185372 +0000 UTC m=+81.386574240" Sep 17 18:30:55.511617 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.511570 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hgr9t" podStartSLOduration=3.016723384 podStartE2EDuration="4.51153151s" totalImagesPullingTime="1.494808126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:55.509842378 +0000 UTC m=+81.447231245" watchObservedRunningTime="2026-09-17 18:30:55.51153151 +0000 UTC m=+81.448920377" Sep 17 18:30:55.529522 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:55.529483 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9fdb94f4-tgjq7"] Sep 17 18:30:56.511711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.511675 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv"] Sep 17 18:30:56.515074 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.515051 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:56.518651 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.518629 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 18:30:56.518743 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.518671 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hfdmh\"" Sep 17 18:30:56.525800 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.525779 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv"] Sep 17 18:30:56.643883 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.643848 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97f3aa4f-9f50-4e64-a7cb-0db0dc50f310-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ml2jv\" (UID: \"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:56.644036 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.643892 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5tjg\" (UniqueName: \"kubernetes.io/projected/97f3aa4f-9f50-4e64-a7cb-0db0dc50f310-kube-api-access-n5tjg\") pod \"monitoring-plugin-5984459ff8-ml2jv\" (UID: \"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:56.744589 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.744553 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5tjg\" (UniqueName: \"kubernetes.io/projected/97f3aa4f-9f50-4e64-a7cb-0db0dc50f310-kube-api-access-n5tjg\") pod \"monitoring-plugin-5984459ff8-ml2jv\" (UID: \"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:56.744746 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.744660 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97f3aa4f-9f50-4e64-a7cb-0db0dc50f310-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ml2jv\" (UID: \"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:56.747299 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.747270 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97f3aa4f-9f50-4e64-a7cb-0db0dc50f310-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ml2jv\" (UID: \"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:56.754480 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.754457 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5tjg\" (UniqueName: \"kubernetes.io/projected/97f3aa4f-9f50-4e64-a7cb-0db0dc50f310-kube-api-access-n5tjg\") pod \"monitoring-plugin-5984459ff8-ml2jv\" (UID: \"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:56.829584 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:56.829546 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:30:57.295754 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.295731 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv"] Sep 17 18:30:57.300478 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:57.300447 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f3aa4f_9f50_4e64_a7cb_0db0dc50f310.slice/crio-e275ad0a86e62ae74553398a9ccd7bae0b28fd9d0bdb03e043bb5a0d7236de44 WatchSource:0}: Error finding container e275ad0a86e62ae74553398a9ccd7bae0b28fd9d0bdb03e043bb5a0d7236de44: Status 404 returned error can't find the container with id e275ad0a86e62ae74553398a9ccd7bae0b28fd9d0bdb03e043bb5a0d7236de44 Sep 17 18:30:57.413745 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.413715 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f68957b7-w788m"] Sep 17 18:30:57.416866 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.416848 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.433258 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.433237 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f68957b7-w788m"] Sep 17 18:30:57.438883 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.438859 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerStarted","Data":"516baf6967ea6c5933aa8bdbdaa6beb64d33b41b6ba6570404e73a68fdd23dee"} Sep 17 18:30:57.438997 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.438916 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerStarted","Data":"fdb162e327a8a9fab798895feeb4affea3889edc4e7a9bd7a3e04132fdb524f7"} Sep 17 18:30:57.438997 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.438944 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerStarted","Data":"ea18e63b5e13d8ea388c47834dc53cc9dd7c12e294a2eed8e746d56f26be1c44"} Sep 17 18:30:57.438997 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.438972 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerStarted","Data":"e89140761208083608a58548de78740433c4d43a5903ce480c73e5ae1f775d44"} Sep 17 18:30:57.439160 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.439016 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerStarted","Data":"070ad988de2ea516218a0404c47d5fa17770fdf0f7a5ee066bae38532a9019aa"} Sep 17 18:30:57.441135 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.441114 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" event={"ID":"712083db-a68f-46b7-acb2-6d3a61b91b05","Type":"ContainerStarted","Data":"717b3d533520ba3ddf2d237e57a85edcfc1aa429405bb0f879f6f85605afce80"} Sep 17 18:30:57.441225 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.441171 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" event={"ID":"712083db-a68f-46b7-acb2-6d3a61b91b05","Type":"ContainerStarted","Data":"43699aa31e581b2622191aa63904ce85971e81480e78aa1b67bdf92c2f7aafd2"} Sep 17 18:30:57.441225 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.441196 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" event={"ID":"712083db-a68f-46b7-acb2-6d3a61b91b05","Type":"ContainerStarted","Data":"a47e47f0e348dfea5de1d0725aafaa706088515aef71035236c98b9954182368"} Sep 17 18:30:57.442267 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.442250 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" event={"ID":"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310","Type":"ContainerStarted","Data":"e275ad0a86e62ae74553398a9ccd7bae0b28fd9d0bdb03e043bb5a0d7236de44"} Sep 17 18:30:57.552713 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.552682 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-oauth-config\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.553159 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.552773 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-console-config\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.553159 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.552885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htt8p\" (UniqueName: \"kubernetes.io/projected/5c4f2f14-4e79-4320-bae7-d70545160552-kube-api-access-htt8p\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.553159 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.552938 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-trusted-ca-bundle\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.553159 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.553004 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-serving-cert\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.553368 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.553157 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-oauth-serving-cert\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.553368 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.553231 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-service-ca\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.654480 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.654402 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-trusted-ca-bundle\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.654480 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.654447 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-serving-cert\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.654480 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.654471 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-oauth-serving-cert\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.654733 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.654504 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-service-ca\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.654733 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.654541 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-oauth-config\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.654733 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.654590 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-console-config\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.654733 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.654620 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htt8p\" (UniqueName: \"kubernetes.io/projected/5c4f2f14-4e79-4320-bae7-d70545160552-kube-api-access-htt8p\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.655403 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.655373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-trusted-ca-bundle\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.655527 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.655481 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-oauth-serving-cert\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.655527 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.655505 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-console-config\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.655645 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.655584 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-service-ca\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.657314 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.657262 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-oauth-config\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.657498 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.657477 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-serving-cert\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.663876 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.663855 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htt8p\" (UniqueName: \"kubernetes.io/projected/5c4f2f14-4e79-4320-bae7-d70545160552-kube-api-access-htt8p\") pod \"console-85f68957b7-w788m\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:57.725429 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:57.725398 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:30:58.018165 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.017735 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f68957b7-w788m"] Sep 17 18:30:58.039685 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:58.039647 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4f2f14_4e79_4320_bae7_d70545160552.slice/crio-f9dd88a0e3605e0cae55831d271a800b63da30d70046cfef8055f598ff196338 WatchSource:0}: Error finding container f9dd88a0e3605e0cae55831d271a800b63da30d70046cfef8055f598ff196338: Status 404 returned error can't find the container with id f9dd88a0e3605e0cae55831d271a800b63da30d70046cfef8055f598ff196338 Sep 17 18:30:58.117510 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.117476 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:30:58.126288 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.126273 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.130750 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.130341 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 18:30:58.130750 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.130376 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 18:30:58.130750 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.130704 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 18:30:58.130972 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.130766 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 18:30:58.130972 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.130905 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 18:30:58.130972 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.130961 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vxzzw\"" Sep 17 18:30:58.131144 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.130706 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2hn0367ql31ne\"" Sep 17 18:30:58.131228 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.131205 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 18:30:58.131608 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.131287 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 18:30:58.132115 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.131718 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 18:30:58.132115 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.131784 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 18:30:58.132115 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.131860 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 18:30:58.133562 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.132556 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 18:30:58.133562 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.132734 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 18:30:58.133562 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.132895 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 18:30:58.144250 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.141944 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 18:30:58.144250 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.142718 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 18:30:58.161343 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.161265 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262491 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ec5a73d-6655-4d58-9f04-2620585be4e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262594 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262617 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262632 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262655 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-config\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262670 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262691 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262712 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb974\" (UniqueName: \"kubernetes.io/projected/9ec5a73d-6655-4d58-9f04-2620585be4e0-kube-api-access-rb974\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262731 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262772 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.262854 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262793 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a73d-6655-4d58-9f04-2620585be4e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263318 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.262961 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263318 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.263046 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263318 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.263106 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263318 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.263137 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263318 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.263167 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263318 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.263211 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263318 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.263269 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.263638 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.263352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.364781 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.364737 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.364955 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.364810 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb974\" (UniqueName: \"kubernetes.io/projected/9ec5a73d-6655-4d58-9f04-2620585be4e0-kube-api-access-rb974\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.364955 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.364841 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.364955 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.364871 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365252 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365301 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a73d-6655-4d58-9f04-2620585be4e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365354 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365393 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365457 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365457 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365480 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365487 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365538 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365597 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365639 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ec5a73d-6655-4d58-9f04-2620585be4e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365667 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365693 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365707 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.366417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365738 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-config\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.367403 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.365761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.367403 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.366298 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.367403 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.366407 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.368557 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.368530 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.368666 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.368637 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.369097 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.369070 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.369534 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.369506 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.369613 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.369558 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ec5a73d-6655-4d58-9f04-2620585be4e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.370015 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.369976 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.370938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.370513 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.370938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.370773 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.370938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.370903 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.371152 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.370960 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.371952 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.371928 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.372119 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.372097 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.372337 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.372317 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a73d-6655-4d58-9f04-2620585be4e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.372565 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.372546 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ec5a73d-6655-4d58-9f04-2620585be4e0-config\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.373908 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.373868 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ec5a73d-6655-4d58-9f04-2620585be4e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.376012 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.375969 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb974\" (UniqueName: \"kubernetes.io/projected/9ec5a73d-6655-4d58-9f04-2620585be4e0-kube-api-access-rb974\") pod \"prometheus-k8s-0\" (UID: \"9ec5a73d-6655-4d58-9f04-2620585be4e0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.454438 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.454397 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" event={"ID":"712083db-a68f-46b7-acb2-6d3a61b91b05","Type":"ContainerStarted","Data":"fa318c5c9d2dd700b712b224be4afb7402f4d4fe997d3d9ed08d9cc70bb3883d"} Sep 17 18:30:58.454615 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.454483 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" event={"ID":"712083db-a68f-46b7-acb2-6d3a61b91b05","Type":"ContainerStarted","Data":"98c749e36e0f4c78282cd582966edfc9e98ca39355ff6b8c402d406105524bd1"} Sep 17 18:30:58.459932 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.459899 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fd6d2c6-efee-425c-8d11-2d62a3aacd0b","Type":"ContainerStarted","Data":"aa599a89134d69a7fdacbf36b39b4c68f1e83e4773851a7f0a0dc8a3c3d219a7"} Sep 17 18:30:58.463607 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.463581 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f68957b7-w788m" event={"ID":"5c4f2f14-4e79-4320-bae7-d70545160552","Type":"ContainerStarted","Data":"e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400"} Sep 17 18:30:58.463711 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.463624 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f68957b7-w788m" event={"ID":"5c4f2f14-4e79-4320-bae7-d70545160552","Type":"ContainerStarted","Data":"f9dd88a0e3605e0cae55831d271a800b63da30d70046cfef8055f598ff196338"} Sep 17 18:30:58.465528 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.465508 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:30:58.492852 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.492788 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.868640351 podStartE2EDuration="6.492768295s" totalImagesPullingTime="3.598714676s" totalInitContainerRuntime="25.413268ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:58.491427444 +0000 UTC m=+84.428816335" watchObservedRunningTime="2026-09-17 18:30:58.492768295 +0000 UTC m=+84.430157168" Sep 17 18:30:58.516078 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.514663 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f68957b7-w788m" podStartSLOduration=1.514637816 podStartE2EDuration="1.514637816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:58.513077536 +0000 UTC m=+84.450466395" watchObservedRunningTime="2026-09-17 18:30:58.514637816 +0000 UTC m=+84.452026683" Sep 17 18:30:58.929199 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:58.929172 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:30:58.931676 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:30:58.931641 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec5a73d_6655_4d58_9f04_2620585be4e0.slice/crio-dcb57d80ce51978146bf6bc4f97346f341bc652fd682f30fd12e3154b08cc4b2 WatchSource:0}: Error finding container dcb57d80ce51978146bf6bc4f97346f341bc652fd682f30fd12e3154b08cc4b2: Status 404 returned error can't find the container with id dcb57d80ce51978146bf6bc4f97346f341bc652fd682f30fd12e3154b08cc4b2 Sep 17 18:30:59.471734 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.471698 2585 generic.go:356] "Generic (PLEG): container finished" podID="9ec5a73d-6655-4d58-9f04-2620585be4e0" containerID="8e982d6911cd0b694508ce5d245ced813318144d0972d9e5f2c4751158b280e6" exitCode=0 Sep 17 18:30:59.471917 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.471808 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerDied","Data":"8e982d6911cd0b694508ce5d245ced813318144d0972d9e5f2c4751158b280e6"} Sep 17 18:30:59.471917 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.471885 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerStarted","Data":"dcb57d80ce51978146bf6bc4f97346f341bc652fd682f30fd12e3154b08cc4b2"} Sep 17 18:30:59.475506 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.475485 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" event={"ID":"712083db-a68f-46b7-acb2-6d3a61b91b05","Type":"ContainerStarted","Data":"31c6a1625cfd58ee6696f126997309a0ee10ee0bb44dead44b9930a3a6f5ae7e"} Sep 17 18:30:59.475632 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.475616 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:30:59.477153 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.477119 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" event={"ID":"97f3aa4f-9f50-4e64-a7cb-0db0dc50f310","Type":"ContainerStarted","Data":"7aafac79e0cfc5fbab3c9deec65243a4d0996a25e9a19343e13b41b87fbc1250"} Sep 17 18:30:59.530828 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.530781 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" podStartSLOduration=3.716666566 podStartE2EDuration="6.530762248s" totalImagesPullingTime="2.814095682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:59.529713822 +0000 UTC m=+85.467102692" watchObservedRunningTime="2026-09-17 18:30:59.530762248 +0000 UTC m=+85.468151116" Sep 17 18:30:59.549088 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:30:59.549045 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" podStartSLOduration=2.152220203 podStartE2EDuration="3.549030483s" totalImagesPullingTime="1.39681028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:30:59.546564606 +0000 UTC m=+85.483953471" watchObservedRunningTime="2026-09-17 18:30:59.549030483 +0000 UTC m=+85.486419479" Sep 17 18:31:00.482630 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:00.482603 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:31:00.488285 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:00.488255 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ml2jv" Sep 17 18:31:02.500103 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:02.499879 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerStarted","Data":"1f694c72b301de3cf8cdd9edd6824bec8b707bb73b8655dbc802bf65a4cf64b1"} Sep 17 18:31:02.500103 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:02.499954 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerStarted","Data":"f7b7733b39f5acd917811c906637703705b42d2642138c169623c69d5cb3bc35"} Sep 17 18:31:02.500103 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:02.500012 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerStarted","Data":"c771dd426ce228924542e458bf99096d755e4efbcf9b9490083f9c54dfa25e5d"} Sep 17 18:31:03.508742 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:03.508706 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerStarted","Data":"81e41ff8c5ebb3fd4ccabfc9e8583bf9ce4e4a062e0c3a0065c163e8433c7ff8"} Sep 17 18:31:03.509114 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:03.508786 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerStarted","Data":"f29ec1cbd9c6df9e110a498a09f1bbb694092ad87ba2ca67862504a0c273eabd"} Sep 17 18:31:03.509114 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:03.508824 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ec5a73d-6655-4d58-9f04-2620585be4e0","Type":"ContainerStarted","Data":"31889f143b3766cb63b22d21f2d41fd159c2687f51ce13fbc450302a89d79a3a"} Sep 17 18:31:03.546620 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:03.546567 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.727782553 podStartE2EDuration="5.546550695s" totalImagesPullingTime="2.801464483s" totalInitContainerRuntime="17.303659ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:31:03.546007552 +0000 UTC m=+89.483396415" watchObservedRunningTime="2026-09-17 18:31:03.546550695 +0000 UTC m=+89.483939559" Sep 17 18:31:05.487772 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:05.487744 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bcbd54f68-4nptl" Sep 17 18:31:07.725834 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:07.725800 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:31:07.726211 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:07.725856 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:31:07.730429 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:07.730408 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:31:08.465726 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:08.465697 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:31:08.539631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:08.539599 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:31:08.607892 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:08.607858 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bbd79f8-w42mw"] Sep 17 18:31:18.382471 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:18.382439 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kd74b" Sep 17 18:31:20.552778 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.552718 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f9fdb94f4-tgjq7" podUID="81f54d08-288b-40df-ad49-1faab8726fae" containerName="console" containerID="cri-o://ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0" gracePeriod=15 Sep 17 18:31:20.817180 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.817111 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:31:20.872067 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872039 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-service-ca\") pod \"81f54d08-288b-40df-ad49-1faab8726fae\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " Sep 17 18:31:20.872067 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872070 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-oauth-serving-cert\") pod \"81f54d08-288b-40df-ad49-1faab8726fae\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " Sep 17 18:31:20.872310 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872088 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr44h\" (UniqueName: \"kubernetes.io/projected/81f54d08-288b-40df-ad49-1faab8726fae-kube-api-access-pr44h\") pod \"81f54d08-288b-40df-ad49-1faab8726fae\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " Sep 17 18:31:20.872310 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872128 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-oauth-config\") pod \"81f54d08-288b-40df-ad49-1faab8726fae\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " Sep 17 18:31:20.872310 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872265 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-console-config\") pod \"81f54d08-288b-40df-ad49-1faab8726fae\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " Sep 17 18:31:20.872460 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872360 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-serving-cert\") pod \"81f54d08-288b-40df-ad49-1faab8726fae\" (UID: \"81f54d08-288b-40df-ad49-1faab8726fae\") " Sep 17 18:31:20.872539 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872498 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81f54d08-288b-40df-ad49-1faab8726fae" (UID: "81f54d08-288b-40df-ad49-1faab8726fae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:31:20.872632 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872516 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-service-ca" (OuterVolumeSpecName: "service-ca") pod "81f54d08-288b-40df-ad49-1faab8726fae" (UID: "81f54d08-288b-40df-ad49-1faab8726fae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:31:20.872682 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872633 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-console-config" (OuterVolumeSpecName: "console-config") pod "81f54d08-288b-40df-ad49-1faab8726fae" (UID: "81f54d08-288b-40df-ad49-1faab8726fae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:31:20.872752 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872733 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-console-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:20.872808 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872757 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-service-ca\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:20.872808 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.872770 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81f54d08-288b-40df-ad49-1faab8726fae-oauth-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:20.874577 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.874555 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81f54d08-288b-40df-ad49-1faab8726fae" (UID: "81f54d08-288b-40df-ad49-1faab8726fae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:31:20.874678 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.874584 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81f54d08-288b-40df-ad49-1faab8726fae-kube-api-access-pr44h" (OuterVolumeSpecName: "kube-api-access-pr44h") pod "81f54d08-288b-40df-ad49-1faab8726fae" (UID: "81f54d08-288b-40df-ad49-1faab8726fae"). InnerVolumeSpecName "kube-api-access-pr44h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:31:20.874678 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.874616 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81f54d08-288b-40df-ad49-1faab8726fae" (UID: "81f54d08-288b-40df-ad49-1faab8726fae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:31:20.974121 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.974091 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr44h\" (UniqueName: \"kubernetes.io/projected/81f54d08-288b-40df-ad49-1faab8726fae-kube-api-access-pr44h\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:20.974121 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.974118 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-oauth-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:20.974121 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:20.974127 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81f54d08-288b-40df-ad49-1faab8726fae-console-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:21.588576 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.588539 2585 generic.go:356] "Generic (PLEG): container finished" podID="81f54d08-288b-40df-ad49-1faab8726fae" containerID="ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0" exitCode=0 Sep 17 18:31:21.589020 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.588584 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9fdb94f4-tgjq7" Sep 17 18:31:21.589020 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.588596 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9fdb94f4-tgjq7" event={"ID":"81f54d08-288b-40df-ad49-1faab8726fae","Type":"ContainerDied","Data":"ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0"} Sep 17 18:31:21.589020 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.588645 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9fdb94f4-tgjq7" event={"ID":"81f54d08-288b-40df-ad49-1faab8726fae","Type":"ContainerDied","Data":"e78b2bd55d61f4df28d145443a347ee0f2f80a792f63481cf65b95a4ee81a6c2"} Sep 17 18:31:21.589020 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.588668 2585 scope.go:117] "RemoveContainer" containerID="ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0" Sep 17 18:31:21.599104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.599086 2585 scope.go:117] "RemoveContainer" containerID="ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0" Sep 17 18:31:21.599378 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:31:21.599357 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0\": container with ID starting with ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0 not found: ID does not exist" containerID="ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0" Sep 17 18:31:21.599457 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.599387 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0"} err="failed to get container status \"ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0\": rpc error: code = NotFound desc = could not find container \"ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0\": container with ID starting with ae4017b55a2ce8b4e43829d1e164e9bcd0dab8703de8991ce68e1449d3c8fee0 not found: ID does not exist" Sep 17 18:31:21.614219 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.614190 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9fdb94f4-tgjq7"] Sep 17 18:31:21.618803 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:21.618781 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f9fdb94f4-tgjq7"] Sep 17 18:31:22.004722 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:22.004648 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81f54d08-288b-40df-ad49-1faab8726fae" path="/var/lib/kubelet/pods/81f54d08-288b-40df-ad49-1faab8726fae/volumes" Sep 17 18:31:33.627197 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.627143 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65bbd79f8-w42mw" podUID="0108aa41-5a76-4aba-85d0-b24b8e8de408" containerName="console" containerID="cri-o://0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268" gracePeriod=15 Sep 17 18:31:33.856949 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.856926 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:31:33.983691 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.983597 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-service-ca\") pod \"0108aa41-5a76-4aba-85d0-b24b8e8de408\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " Sep 17 18:31:33.983691 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.983634 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzbth\" (UniqueName: \"kubernetes.io/projected/0108aa41-5a76-4aba-85d0-b24b8e8de408-kube-api-access-gzbth\") pod \"0108aa41-5a76-4aba-85d0-b24b8e8de408\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " Sep 17 18:31:33.983691 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.983658 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-serving-cert\") pod \"0108aa41-5a76-4aba-85d0-b24b8e8de408\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " Sep 17 18:31:33.983967 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.983783 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-config\") pod \"0108aa41-5a76-4aba-85d0-b24b8e8de408\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " Sep 17 18:31:33.983967 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.983839 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-oauth-config\") pod \"0108aa41-5a76-4aba-85d0-b24b8e8de408\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " Sep 17 18:31:33.983967 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.983928 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-oauth-serving-cert\") pod \"0108aa41-5a76-4aba-85d0-b24b8e8de408\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " Sep 17 18:31:33.983967 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.983958 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-trusted-ca-bundle\") pod \"0108aa41-5a76-4aba-85d0-b24b8e8de408\" (UID: \"0108aa41-5a76-4aba-85d0-b24b8e8de408\") " Sep 17 18:31:33.984175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.984043 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-service-ca" (OuterVolumeSpecName: "service-ca") pod "0108aa41-5a76-4aba-85d0-b24b8e8de408" (UID: "0108aa41-5a76-4aba-85d0-b24b8e8de408"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:31:33.984259 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.984234 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-config" (OuterVolumeSpecName: "console-config") pod "0108aa41-5a76-4aba-85d0-b24b8e8de408" (UID: "0108aa41-5a76-4aba-85d0-b24b8e8de408"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:31:33.984306 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.984247 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-service-ca\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:33.984363 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.984298 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0108aa41-5a76-4aba-85d0-b24b8e8de408" (UID: "0108aa41-5a76-4aba-85d0-b24b8e8de408"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:31:33.984474 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.984451 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0108aa41-5a76-4aba-85d0-b24b8e8de408" (UID: "0108aa41-5a76-4aba-85d0-b24b8e8de408"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:31:33.985915 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.985891 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0108aa41-5a76-4aba-85d0-b24b8e8de408" (UID: "0108aa41-5a76-4aba-85d0-b24b8e8de408"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:31:33.986068 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.985944 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0108aa41-5a76-4aba-85d0-b24b8e8de408-kube-api-access-gzbth" (OuterVolumeSpecName: "kube-api-access-gzbth") pod "0108aa41-5a76-4aba-85d0-b24b8e8de408" (UID: "0108aa41-5a76-4aba-85d0-b24b8e8de408"). InnerVolumeSpecName "kube-api-access-gzbth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:31:33.986068 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:33.985950 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0108aa41-5a76-4aba-85d0-b24b8e8de408" (UID: "0108aa41-5a76-4aba-85d0-b24b8e8de408"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:31:34.038133 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.038110 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4w846_1f2f41dc-f6ba-4c88-9918-63f61c14248d/serve-healthcheck-canary/0.log" Sep 17 18:31:34.085598 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.085567 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-oauth-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:34.085598 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.085594 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-trusted-ca-bundle\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:34.085598 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.085604 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzbth\" (UniqueName: \"kubernetes.io/projected/0108aa41-5a76-4aba-85d0-b24b8e8de408-kube-api-access-gzbth\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:34.085786 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.085613 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:34.085786 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.085622 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:34.085786 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.085630 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0108aa41-5a76-4aba-85d0-b24b8e8de408-console-oauth-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:31:34.644800 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.644764 2585 generic.go:356] "Generic (PLEG): container finished" podID="0108aa41-5a76-4aba-85d0-b24b8e8de408" containerID="0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268" exitCode=0 Sep 17 18:31:34.645251 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.644829 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbd79f8-w42mw" Sep 17 18:31:34.645251 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.644845 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbd79f8-w42mw" event={"ID":"0108aa41-5a76-4aba-85d0-b24b8e8de408","Type":"ContainerDied","Data":"0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268"} Sep 17 18:31:34.645251 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.644922 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbd79f8-w42mw" event={"ID":"0108aa41-5a76-4aba-85d0-b24b8e8de408","Type":"ContainerDied","Data":"1c8734ffeddf2e96c47733641270c77d72bd57cfb96370b0baaaf7ce9fdc3a58"} Sep 17 18:31:34.645251 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.644943 2585 scope.go:117] "RemoveContainer" containerID="0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268" Sep 17 18:31:34.654222 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.654205 2585 scope.go:117] "RemoveContainer" containerID="0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268" Sep 17 18:31:34.654465 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:31:34.654446 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268\": container with ID starting with 0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268 not found: ID does not exist" containerID="0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268" Sep 17 18:31:34.654513 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.654473 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268"} err="failed to get container status \"0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268\": rpc error: code = NotFound desc = could not find container \"0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268\": container with ID starting with 0fa0de57e1884b4d6a7b733b542a3443cb09c134aac6defdc56fe5db3e98e268 not found: ID does not exist" Sep 17 18:31:34.666234 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.666206 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bbd79f8-w42mw"] Sep 17 18:31:34.676086 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:34.676063 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65bbd79f8-w42mw"] Sep 17 18:31:36.004068 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:36.004034 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0108aa41-5a76-4aba-85d0-b24b8e8de408" path="/var/lib/kubelet/pods/0108aa41-5a76-4aba-85d0-b24b8e8de408/volumes" Sep 17 18:31:58.466164 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:58.466127 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:31:58.484626 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:58.484604 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:31:58.757480 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:31:58.757410 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:32:20.687600 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.687520 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b45c5f74b-kqr89"] Sep 17 18:32:20.688056 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.687856 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81f54d08-288b-40df-ad49-1faab8726fae" containerName="console" Sep 17 18:32:20.688056 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.687868 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="81f54d08-288b-40df-ad49-1faab8726fae" containerName="console" Sep 17 18:32:20.688056 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.687890 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0108aa41-5a76-4aba-85d0-b24b8e8de408" containerName="console" Sep 17 18:32:20.688056 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.687896 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0108aa41-5a76-4aba-85d0-b24b8e8de408" containerName="console" Sep 17 18:32:20.688056 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.687944 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0108aa41-5a76-4aba-85d0-b24b8e8de408" containerName="console" Sep 17 18:32:20.688056 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.687956 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="81f54d08-288b-40df-ad49-1faab8726fae" containerName="console" Sep 17 18:32:20.690898 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.690881 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.709641 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.709609 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b45c5f74b-kqr89"] Sep 17 18:32:20.786993 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.786956 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-oauth-config\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.787175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.787018 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8clv\" (UniqueName: \"kubernetes.io/projected/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-kube-api-access-p8clv\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.787175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.787107 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-service-ca\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.787175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.787136 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-trusted-ca-bundle\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.787175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.787161 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-oauth-serving-cert\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.787310 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.787252 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-serving-cert\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.787349 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.787313 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-config\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.887743 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.887702 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-service-ca\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.887743 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.887741 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-trusted-ca-bundle\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.887956 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.887761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-oauth-serving-cert\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.887956 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.887811 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-serving-cert\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.887956 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.887871 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-config\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.887956 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.887904 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-oauth-config\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.887956 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.887925 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8clv\" (UniqueName: \"kubernetes.io/projected/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-kube-api-access-p8clv\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.888592 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.888555 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-service-ca\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.888715 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.888663 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-oauth-serving-cert\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.888715 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.888692 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-config\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.888916 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.888896 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-trusted-ca-bundle\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.890476 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.890442 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-oauth-config\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.890598 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.890542 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-serving-cert\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.897580 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.897553 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8clv\" (UniqueName: \"kubernetes.io/projected/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-kube-api-access-p8clv\") pod \"console-6b45c5f74b-kqr89\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:20.999923 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:20.999825 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:21.299815 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:21.299778 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b45c5f74b-kqr89"] Sep 17 18:32:21.305017 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:32:21.304962 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14a96c8_c6c6_4109_bd52_2e63f494bc5a.slice/crio-d6840bd1652ec91fde5283823d51fd9fb409c19dc2ba4f1199ac982f96ad828e WatchSource:0}: Error finding container d6840bd1652ec91fde5283823d51fd9fb409c19dc2ba4f1199ac982f96ad828e: Status 404 returned error can't find the container with id d6840bd1652ec91fde5283823d51fd9fb409c19dc2ba4f1199ac982f96ad828e Sep 17 18:32:21.833695 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:21.833658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b45c5f74b-kqr89" event={"ID":"e14a96c8-c6c6-4109-bd52-2e63f494bc5a","Type":"ContainerStarted","Data":"0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774"} Sep 17 18:32:21.834090 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:21.833709 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b45c5f74b-kqr89" event={"ID":"e14a96c8-c6c6-4109-bd52-2e63f494bc5a","Type":"ContainerStarted","Data":"d6840bd1652ec91fde5283823d51fd9fb409c19dc2ba4f1199ac982f96ad828e"} Sep 17 18:32:21.859081 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:21.859021 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b45c5f74b-kqr89" podStartSLOduration=1.859001959 podStartE2EDuration="1.859001959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:32:21.858659754 +0000 UTC m=+167.796048619" watchObservedRunningTime="2026-09-17 18:32:21.859001959 +0000 UTC m=+167.796390821" Sep 17 18:32:29.667518 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.667484 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b45c5f74b-kqr89"] Sep 17 18:32:29.757741 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.757710 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c999f58c-gz22j"] Sep 17 18:32:29.761439 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.761421 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868401 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868365 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-oauth-config\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868401 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868399 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-oauth-serving-cert\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868418 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-trusted-ca-bundle\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868502 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-config\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868536 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrt5k\" (UniqueName: \"kubernetes.io/projected/1e34950e-8f40-452b-8b7a-17aab5025cdd-kube-api-access-vrt5k\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868579 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-service-ca\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868600 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-serving-cert\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.868804 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.868726 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c999f58c-gz22j"] Sep 17 18:32:29.969962 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.969867 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-oauth-config\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.969962 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.969906 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-oauth-serving-cert\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.969962 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.969926 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-trusted-ca-bundle\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.969962 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.969945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-config\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.970291 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.970014 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrt5k\" (UniqueName: \"kubernetes.io/projected/1e34950e-8f40-452b-8b7a-17aab5025cdd-kube-api-access-vrt5k\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.970291 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.970105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-service-ca\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.970291 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.970135 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-serving-cert\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.970817 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.970792 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-oauth-serving-cert\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.970817 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.970807 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-config\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.970974 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.970881 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-trusted-ca-bundle\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.970974 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.970931 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-service-ca\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.972584 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.972553 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-oauth-config\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.972679 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.972560 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-serving-cert\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:29.982398 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:29.982373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrt5k\" (UniqueName: \"kubernetes.io/projected/1e34950e-8f40-452b-8b7a-17aab5025cdd-kube-api-access-vrt5k\") pod \"console-84c999f58c-gz22j\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:30.070785 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:30.070746 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:30.362629 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:30.362606 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c999f58c-gz22j"] Sep 17 18:32:30.365520 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:32:30.365489 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e34950e_8f40_452b_8b7a_17aab5025cdd.slice/crio-030b5e798c5c31c5f005a40eeeb91add25e014e3f41fdc6eca6449ab0486fa0e WatchSource:0}: Error finding container 030b5e798c5c31c5f005a40eeeb91add25e014e3f41fdc6eca6449ab0486fa0e: Status 404 returned error can't find the container with id 030b5e798c5c31c5f005a40eeeb91add25e014e3f41fdc6eca6449ab0486fa0e Sep 17 18:32:30.873788 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:30.873755 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c999f58c-gz22j" event={"ID":"1e34950e-8f40-452b-8b7a-17aab5025cdd","Type":"ContainerStarted","Data":"02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf"} Sep 17 18:32:30.874214 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:30.873812 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c999f58c-gz22j" event={"ID":"1e34950e-8f40-452b-8b7a-17aab5025cdd","Type":"ContainerStarted","Data":"030b5e798c5c31c5f005a40eeeb91add25e014e3f41fdc6eca6449ab0486fa0e"} Sep 17 18:32:30.903755 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:30.903698 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c999f58c-gz22j" podStartSLOduration=1.9036813110000002 podStartE2EDuration="1.903681311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:32:30.901164939 +0000 UTC m=+176.838553804" watchObservedRunningTime="2026-09-17 18:32:30.903681311 +0000 UTC m=+176.841070270" Sep 17 18:32:31.000127 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:31.000094 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:40.071121 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:40.071081 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:40.071604 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:40.071139 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:40.075997 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:40.075955 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:40.919673 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:40.919640 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:32:41.028414 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:41.028384 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f68957b7-w788m"] Sep 17 18:32:54.686005 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.685928 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b45c5f74b-kqr89" podUID="e14a96c8-c6c6-4109-bd52-2e63f494bc5a" containerName="console" containerID="cri-o://0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774" gracePeriod=15 Sep 17 18:32:54.926015 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.925969 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:54.974479 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.974390 2585 generic.go:356] "Generic (PLEG): container finished" podID="e14a96c8-c6c6-4109-bd52-2e63f494bc5a" containerID="0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774" exitCode=0 Sep 17 18:32:54.974479 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.974442 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b45c5f74b-kqr89" Sep 17 18:32:54.974479 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.974466 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b45c5f74b-kqr89" event={"ID":"e14a96c8-c6c6-4109-bd52-2e63f494bc5a","Type":"ContainerDied","Data":"0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774"} Sep 17 18:32:54.974754 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.974517 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b45c5f74b-kqr89" event={"ID":"e14a96c8-c6c6-4109-bd52-2e63f494bc5a","Type":"ContainerDied","Data":"d6840bd1652ec91fde5283823d51fd9fb409c19dc2ba4f1199ac982f96ad828e"} Sep 17 18:32:54.974754 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.974538 2585 scope.go:117] "RemoveContainer" containerID="0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774" Sep 17 18:32:54.983342 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.983326 2585 scope.go:117] "RemoveContainer" containerID="0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774" Sep 17 18:32:54.983604 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:32:54.983586 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774\": container with ID starting with 0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774 not found: ID does not exist" containerID="0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774" Sep 17 18:32:54.983649 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:54.983611 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774"} err="failed to get container status \"0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774\": rpc error: code = NotFound desc = could not find container \"0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774\": container with ID starting with 0bab87b8e1ab1ecf16dbd4a639fa3aee0fcf6a807d50d1da1a162ad47dd7e774 not found: ID does not exist" Sep 17 18:32:55.008079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008041 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-oauth-serving-cert\") pod \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " Sep 17 18:32:55.008079 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008086 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-service-ca\") pod \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " Sep 17 18:32:55.008240 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008134 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-oauth-config\") pod \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " Sep 17 18:32:55.008240 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008162 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8clv\" (UniqueName: \"kubernetes.io/projected/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-kube-api-access-p8clv\") pod \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " Sep 17 18:32:55.008240 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008190 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-config\") pod \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " Sep 17 18:32:55.008240 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008228 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-trusted-ca-bundle\") pod \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " Sep 17 18:32:55.008424 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008306 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-serving-cert\") pod \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\" (UID: \"e14a96c8-c6c6-4109-bd52-2e63f494bc5a\") " Sep 17 18:32:55.008473 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008452 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e14a96c8-c6c6-4109-bd52-2e63f494bc5a" (UID: "e14a96c8-c6c6-4109-bd52-2e63f494bc5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:32:55.008662 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008597 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e14a96c8-c6c6-4109-bd52-2e63f494bc5a" (UID: "e14a96c8-c6c6-4109-bd52-2e63f494bc5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:32:55.008736 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008642 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-oauth-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:32:55.008736 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008637 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-config" (OuterVolumeSpecName: "console-config") pod "e14a96c8-c6c6-4109-bd52-2e63f494bc5a" (UID: "e14a96c8-c6c6-4109-bd52-2e63f494bc5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:32:55.008852 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.008775 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e14a96c8-c6c6-4109-bd52-2e63f494bc5a" (UID: "e14a96c8-c6c6-4109-bd52-2e63f494bc5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:32:55.010310 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.010280 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-kube-api-access-p8clv" (OuterVolumeSpecName: "kube-api-access-p8clv") pod "e14a96c8-c6c6-4109-bd52-2e63f494bc5a" (UID: "e14a96c8-c6c6-4109-bd52-2e63f494bc5a"). InnerVolumeSpecName "kube-api-access-p8clv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:32:55.010420 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.010360 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e14a96c8-c6c6-4109-bd52-2e63f494bc5a" (UID: "e14a96c8-c6c6-4109-bd52-2e63f494bc5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:32:55.010509 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.010487 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e14a96c8-c6c6-4109-bd52-2e63f494bc5a" (UID: "e14a96c8-c6c6-4109-bd52-2e63f494bc5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:32:55.110063 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.110018 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-service-ca\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:32:55.110063 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.110060 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-oauth-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:32:55.110063 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.110070 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8clv\" (UniqueName: \"kubernetes.io/projected/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-kube-api-access-p8clv\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:32:55.110063 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.110079 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:32:55.110339 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.110087 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-trusted-ca-bundle\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:32:55.110339 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.110095 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e14a96c8-c6c6-4109-bd52-2e63f494bc5a-console-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:32:55.305999 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.303503 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b45c5f74b-kqr89"] Sep 17 18:32:55.310090 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:55.310064 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b45c5f74b-kqr89"] Sep 17 18:32:56.006339 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:32:56.006301 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14a96c8-c6c6-4109-bd52-2e63f494bc5a" path="/var/lib/kubelet/pods/e14a96c8-c6c6-4109-bd52-2e63f494bc5a/volumes" Sep 17 18:33:06.047095 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.047031 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85f68957b7-w788m" podUID="5c4f2f14-4e79-4320-bae7-d70545160552" containerName="console" containerID="cri-o://e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400" gracePeriod=15 Sep 17 18:33:06.308867 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.308808 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:33:06.428876 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.428837 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-trusted-ca-bundle\") pod \"5c4f2f14-4e79-4320-bae7-d70545160552\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " Sep 17 18:33:06.429073 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.428889 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-oauth-serving-cert\") pod \"5c4f2f14-4e79-4320-bae7-d70545160552\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " Sep 17 18:33:06.429073 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.428923 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-oauth-config\") pod \"5c4f2f14-4e79-4320-bae7-d70545160552\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " Sep 17 18:33:06.429073 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.428962 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-service-ca\") pod \"5c4f2f14-4e79-4320-bae7-d70545160552\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " Sep 17 18:33:06.429073 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.429026 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htt8p\" (UniqueName: \"kubernetes.io/projected/5c4f2f14-4e79-4320-bae7-d70545160552-kube-api-access-htt8p\") pod \"5c4f2f14-4e79-4320-bae7-d70545160552\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " Sep 17 18:33:06.429073 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.429072 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-serving-cert\") pod \"5c4f2f14-4e79-4320-bae7-d70545160552\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " Sep 17 18:33:06.429384 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.429106 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-console-config\") pod \"5c4f2f14-4e79-4320-bae7-d70545160552\" (UID: \"5c4f2f14-4e79-4320-bae7-d70545160552\") " Sep 17 18:33:06.429384 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.429352 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c4f2f14-4e79-4320-bae7-d70545160552" (UID: "5c4f2f14-4e79-4320-bae7-d70545160552"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:33:06.429496 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.429415 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c4f2f14-4e79-4320-bae7-d70545160552" (UID: "5c4f2f14-4e79-4320-bae7-d70545160552"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:33:06.429658 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.429577 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c4f2f14-4e79-4320-bae7-d70545160552" (UID: "5c4f2f14-4e79-4320-bae7-d70545160552"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:33:06.429732 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.429706 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-console-config" (OuterVolumeSpecName: "console-config") pod "5c4f2f14-4e79-4320-bae7-d70545160552" (UID: "5c4f2f14-4e79-4320-bae7-d70545160552"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:33:06.431319 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.431293 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c4f2f14-4e79-4320-bae7-d70545160552" (UID: "5c4f2f14-4e79-4320-bae7-d70545160552"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:33:06.431319 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.431314 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c4f2f14-4e79-4320-bae7-d70545160552-kube-api-access-htt8p" (OuterVolumeSpecName: "kube-api-access-htt8p") pod "5c4f2f14-4e79-4320-bae7-d70545160552" (UID: "5c4f2f14-4e79-4320-bae7-d70545160552"). InnerVolumeSpecName "kube-api-access-htt8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:33:06.431467 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.431314 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c4f2f14-4e79-4320-bae7-d70545160552" (UID: "5c4f2f14-4e79-4320-bae7-d70545160552"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:33:06.529767 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.529723 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-console-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:33:06.529767 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.529758 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-trusted-ca-bundle\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:33:06.529767 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.529774 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-oauth-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:33:06.530023 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.529786 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-oauth-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:33:06.530023 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.529797 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c4f2f14-4e79-4320-bae7-d70545160552-service-ca\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:33:06.530023 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.529808 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htt8p\" (UniqueName: \"kubernetes.io/projected/5c4f2f14-4e79-4320-bae7-d70545160552-kube-api-access-htt8p\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:33:06.530023 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:06.529819 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c4f2f14-4e79-4320-bae7-d70545160552-console-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:33:07.022652 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.022617 2585 generic.go:356] "Generic (PLEG): container finished" podID="5c4f2f14-4e79-4320-bae7-d70545160552" containerID="e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400" exitCode=0 Sep 17 18:33:07.022849 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.022667 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f68957b7-w788m" Sep 17 18:33:07.022849 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.022666 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f68957b7-w788m" event={"ID":"5c4f2f14-4e79-4320-bae7-d70545160552","Type":"ContainerDied","Data":"e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400"} Sep 17 18:33:07.022849 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.022790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f68957b7-w788m" event={"ID":"5c4f2f14-4e79-4320-bae7-d70545160552","Type":"ContainerDied","Data":"f9dd88a0e3605e0cae55831d271a800b63da30d70046cfef8055f598ff196338"} Sep 17 18:33:07.022849 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.022818 2585 scope.go:117] "RemoveContainer" containerID="e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400" Sep 17 18:33:07.031503 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.031482 2585 scope.go:117] "RemoveContainer" containerID="e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400" Sep 17 18:33:07.031784 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:33:07.031768 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400\": container with ID starting with e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400 not found: ID does not exist" containerID="e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400" Sep 17 18:33:07.031831 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.031794 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400"} err="failed to get container status \"e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400\": rpc error: code = NotFound desc = could not find container \"e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400\": container with ID starting with e83178140eb3bf77c037c7e8cac572e0f51a2d68d07b64c845b76ebafd995400 not found: ID does not exist" Sep 17 18:33:07.045896 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.045861 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f68957b7-w788m"] Sep 17 18:33:07.050667 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:07.050641 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85f68957b7-w788m"] Sep 17 18:33:08.004544 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:33:08.004511 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c4f2f14-4e79-4320-bae7-d70545160552" path="/var/lib/kubelet/pods/5c4f2f14-4e79-4320-bae7-d70545160552/volumes" Sep 17 18:34:35.935276 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:34:35.935249 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:34:35.938106 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:34:35.938085 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:34:35.940748 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:34:35.940723 2585 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 18:35:26.519501 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.519423 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d66h7"] Sep 17 18:35:26.519902 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.519759 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14a96c8-c6c6-4109-bd52-2e63f494bc5a" containerName="console" Sep 17 18:35:26.519902 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.519770 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14a96c8-c6c6-4109-bd52-2e63f494bc5a" containerName="console" Sep 17 18:35:26.519902 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.519786 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c4f2f14-4e79-4320-bae7-d70545160552" containerName="console" Sep 17 18:35:26.519902 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.519791 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4f2f14-4e79-4320-bae7-d70545160552" containerName="console" Sep 17 18:35:26.519902 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.519853 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c4f2f14-4e79-4320-bae7-d70545160552" containerName="console" Sep 17 18:35:26.519902 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.519863 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14a96c8-c6c6-4109-bd52-2e63f494bc5a" containerName="console" Sep 17 18:35:26.522736 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.522712 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:26.525408 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.525386 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 18:35:26.525585 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.525571 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 18:35:26.526572 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.526553 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2jxp6\"" Sep 17 18:35:26.533525 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.533505 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d66h7"] Sep 17 18:35:26.623927 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.623888 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6hcs\" (UniqueName: \"kubernetes.io/projected/79ad7139-5b14-4338-8f7d-ad93134f1cd8-kube-api-access-j6hcs\") pod \"cert-manager-cainjector-559cdd8c87-d66h7\" (UID: \"79ad7139-5b14-4338-8f7d-ad93134f1cd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:26.624175 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.623941 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ad7139-5b14-4338-8f7d-ad93134f1cd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d66h7\" (UID: \"79ad7139-5b14-4338-8f7d-ad93134f1cd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:26.724348 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.724309 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6hcs\" (UniqueName: \"kubernetes.io/projected/79ad7139-5b14-4338-8f7d-ad93134f1cd8-kube-api-access-j6hcs\") pod \"cert-manager-cainjector-559cdd8c87-d66h7\" (UID: \"79ad7139-5b14-4338-8f7d-ad93134f1cd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:26.724517 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.724370 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ad7139-5b14-4338-8f7d-ad93134f1cd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d66h7\" (UID: \"79ad7139-5b14-4338-8f7d-ad93134f1cd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:26.733667 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.733637 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ad7139-5b14-4338-8f7d-ad93134f1cd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d66h7\" (UID: \"79ad7139-5b14-4338-8f7d-ad93134f1cd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:26.733828 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.733811 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6hcs\" (UniqueName: \"kubernetes.io/projected/79ad7139-5b14-4338-8f7d-ad93134f1cd8-kube-api-access-j6hcs\") pod \"cert-manager-cainjector-559cdd8c87-d66h7\" (UID: \"79ad7139-5b14-4338-8f7d-ad93134f1cd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:26.842575 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:26.842540 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" Sep 17 18:35:27.124618 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:27.124424 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d66h7"] Sep 17 18:35:27.127298 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:35:27.127262 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79ad7139_5b14_4338_8f7d_ad93134f1cd8.slice/crio-d788b332831550002031cc6baf022abbf3494483831fbee084bab9d0baf1aeda WatchSource:0}: Error finding container d788b332831550002031cc6baf022abbf3494483831fbee084bab9d0baf1aeda: Status 404 returned error can't find the container with id d788b332831550002031cc6baf022abbf3494483831fbee084bab9d0baf1aeda Sep 17 18:35:27.129408 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:27.129388 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:35:27.577625 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:27.577593 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" event={"ID":"79ad7139-5b14-4338-8f7d-ad93134f1cd8","Type":"ContainerStarted","Data":"d788b332831550002031cc6baf022abbf3494483831fbee084bab9d0baf1aeda"} Sep 17 18:35:32.601642 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:32.601602 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" event={"ID":"79ad7139-5b14-4338-8f7d-ad93134f1cd8","Type":"ContainerStarted","Data":"490d05b6ad48052ce5b3897c33911f68c466e1b724c467fba97d586549ec8599"} Sep 17 18:35:32.618706 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:32.618652 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d66h7" podStartSLOduration=2.077353074 podStartE2EDuration="6.618635195s" totalImagesPullingTime="4.541282121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:35:32.617929878 +0000 UTC m=+358.555318745" watchObservedRunningTime="2026-09-17 18:35:32.618635195 +0000 UTC m=+358.556024060" Sep 17 18:35:41.553649 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.553620 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb566b88b-hlpqs"] Sep 17 18:35:41.557168 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.557148 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.569788 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.569768 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb566b88b-hlpqs"] Sep 17 18:35:41.659004 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.658962 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bgkc\" (UniqueName: \"kubernetes.io/projected/7d657f20-723e-4344-85b5-d39ecc2976ad-kube-api-access-9bgkc\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.659161 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.659037 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-oauth-serving-cert\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.659161 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.659090 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d657f20-723e-4344-85b5-d39ecc2976ad-console-oauth-config\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.659161 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.659116 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-trusted-ca-bundle\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.659282 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.659192 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-console-config\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.659282 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.659210 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-service-ca\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.659282 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.659233 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d657f20-723e-4344-85b5-d39ecc2976ad-console-serving-cert\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.759997 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.759950 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-oauth-serving-cert\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760106 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760009 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d657f20-723e-4344-85b5-d39ecc2976ad-console-oauth-config\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760106 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760030 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-trusted-ca-bundle\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760106 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760058 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-console-config\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760106 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760072 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-service-ca\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760106 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760089 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d657f20-723e-4344-85b5-d39ecc2976ad-console-serving-cert\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760302 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760130 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgkc\" (UniqueName: \"kubernetes.io/projected/7d657f20-723e-4344-85b5-d39ecc2976ad-kube-api-access-9bgkc\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760753 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760720 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-oauth-serving-cert\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760865 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760798 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-console-config\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.760931 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.760889 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-service-ca\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.761063 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.761043 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d657f20-723e-4344-85b5-d39ecc2976ad-trusted-ca-bundle\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.762572 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.762548 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d657f20-723e-4344-85b5-d39ecc2976ad-console-serving-cert\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.762653 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.762582 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d657f20-723e-4344-85b5-d39ecc2976ad-console-oauth-config\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.768581 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.768560 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bgkc\" (UniqueName: \"kubernetes.io/projected/7d657f20-723e-4344-85b5-d39ecc2976ad-kube-api-access-9bgkc\") pod \"console-7cb566b88b-hlpqs\" (UID: \"7d657f20-723e-4344-85b5-d39ecc2976ad\") " pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:41.866452 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:41.866396 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:42.141279 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:42.141206 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb566b88b-hlpqs"] Sep 17 18:35:42.144620 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:35:42.144591 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d657f20_723e_4344_85b5_d39ecc2976ad.slice/crio-daa29aa383789006b9f5f03fc0fc125e8480bb2a14339821b3d1b3fdf3c8c6f7 WatchSource:0}: Error finding container daa29aa383789006b9f5f03fc0fc125e8480bb2a14339821b3d1b3fdf3c8c6f7: Status 404 returned error can't find the container with id daa29aa383789006b9f5f03fc0fc125e8480bb2a14339821b3d1b3fdf3c8c6f7 Sep 17 18:35:42.642898 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:42.642862 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb566b88b-hlpqs" event={"ID":"7d657f20-723e-4344-85b5-d39ecc2976ad","Type":"ContainerStarted","Data":"93f5402276c2ba6bee0bcb057fc050e84f45be76443c0f413e1ddc1d28a39d9a"} Sep 17 18:35:42.643302 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:42.642908 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb566b88b-hlpqs" event={"ID":"7d657f20-723e-4344-85b5-d39ecc2976ad","Type":"ContainerStarted","Data":"daa29aa383789006b9f5f03fc0fc125e8480bb2a14339821b3d1b3fdf3c8c6f7"} Sep 17 18:35:42.663690 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:42.663641 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb566b88b-hlpqs" podStartSLOduration=1.663625899 podStartE2EDuration="1.663625899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:35:42.662485526 +0000 UTC m=+368.599874397" watchObservedRunningTime="2026-09-17 18:35:42.663625899 +0000 UTC m=+368.601014765" Sep 17 18:35:51.867486 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:51.867445 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:51.868007 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:51.867530 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:51.872416 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:51.872390 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:52.686302 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:52.686275 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cb566b88b-hlpqs" Sep 17 18:35:52.743324 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:35:52.743291 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c999f58c-gz22j"] Sep 17 18:36:12.295326 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.295292 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6"] Sep 17 18:36:12.301326 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.301299 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.306718 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.306687 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 18:36:12.306718 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.306687 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jhq2t\"" Sep 17 18:36:12.306891 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.306826 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 18:36:12.306941 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.306928 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 18:36:12.307013 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.306975 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:36:12.307068 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.307050 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 18:36:12.326542 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.326518 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6"] Sep 17 18:36:12.433835 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.433796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99845284-5f60-4634-a601-c1a25b32ea74-metrics-cert\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.434022 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.433883 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99845284-5f60-4634-a601-c1a25b32ea74-manager-config\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.434022 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.433917 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcd5p\" (UniqueName: \"kubernetes.io/projected/99845284-5f60-4634-a601-c1a25b32ea74-kube-api-access-jcd5p\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.434022 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.433940 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99845284-5f60-4634-a601-c1a25b32ea74-cert\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.535245 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.535207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99845284-5f60-4634-a601-c1a25b32ea74-metrics-cert\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.535419 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.535292 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99845284-5f60-4634-a601-c1a25b32ea74-manager-config\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.535419 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.535320 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcd5p\" (UniqueName: \"kubernetes.io/projected/99845284-5f60-4634-a601-c1a25b32ea74-kube-api-access-jcd5p\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.535419 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.535342 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99845284-5f60-4634-a601-c1a25b32ea74-cert\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.536068 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.536042 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99845284-5f60-4634-a601-c1a25b32ea74-manager-config\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.537680 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.537658 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99845284-5f60-4634-a601-c1a25b32ea74-metrics-cert\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.537780 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.537714 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99845284-5f60-4634-a601-c1a25b32ea74-cert\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.545631 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.545583 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcd5p\" (UniqueName: \"kubernetes.io/projected/99845284-5f60-4634-a601-c1a25b32ea74-kube-api-access-jcd5p\") pod \"lws-controller-manager-7594644fcd-ws5w6\" (UID: \"99845284-5f60-4634-a601-c1a25b32ea74\") " pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.611650 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.611597 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:12.889893 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:12.889815 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6"] Sep 17 18:36:13.769050 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:13.769014 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" event={"ID":"99845284-5f60-4634-a601-c1a25b32ea74","Type":"ContainerStarted","Data":"6fbfa9c2b5e03e0ea32c32b3a6a79207b8503dfdc93cae1c56d72132056d98ed"} Sep 17 18:36:15.779148 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:15.779111 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" event={"ID":"99845284-5f60-4634-a601-c1a25b32ea74","Type":"ContainerStarted","Data":"bbcd78824eee2c7a922744be019f289027eba1e9214daad067dc30c6fefd6b6e"} Sep 17 18:36:15.779522 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:15.779190 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:15.799048 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:15.799000 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" podStartSLOduration=1.080716499 podStartE2EDuration="3.798974752s" totalImagesPullingTime="2.718258253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:36:15.796468615 +0000 UTC m=+401.733857479" watchObservedRunningTime="2026-09-17 18:36:15.798974752 +0000 UTC m=+401.736363618" Sep 17 18:36:17.763713 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:17.763649 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84c999f58c-gz22j" podUID="1e34950e-8f40-452b-8b7a-17aab5025cdd" containerName="console" containerID="cri-o://02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf" gracePeriod=15 Sep 17 18:36:17.998248 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:17.998217 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:36:18.083770 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.083742 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-service-ca\") pod \"1e34950e-8f40-452b-8b7a-17aab5025cdd\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " Sep 17 18:36:18.083928 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.083788 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-config\") pod \"1e34950e-8f40-452b-8b7a-17aab5025cdd\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " Sep 17 18:36:18.083928 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.083808 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-serving-cert\") pod \"1e34950e-8f40-452b-8b7a-17aab5025cdd\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " Sep 17 18:36:18.083928 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.083838 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrt5k\" (UniqueName: \"kubernetes.io/projected/1e34950e-8f40-452b-8b7a-17aab5025cdd-kube-api-access-vrt5k\") pod \"1e34950e-8f40-452b-8b7a-17aab5025cdd\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " Sep 17 18:36:18.083928 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.083891 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-oauth-serving-cert\") pod \"1e34950e-8f40-452b-8b7a-17aab5025cdd\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " Sep 17 18:36:18.083928 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.083919 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-trusted-ca-bundle\") pod \"1e34950e-8f40-452b-8b7a-17aab5025cdd\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " Sep 17 18:36:18.084214 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.083960 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-oauth-config\") pod \"1e34950e-8f40-452b-8b7a-17aab5025cdd\" (UID: \"1e34950e-8f40-452b-8b7a-17aab5025cdd\") " Sep 17 18:36:18.084272 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.084243 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-service-ca" (OuterVolumeSpecName: "service-ca") pod "1e34950e-8f40-452b-8b7a-17aab5025cdd" (UID: "1e34950e-8f40-452b-8b7a-17aab5025cdd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:36:18.084400 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.084341 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-config" (OuterVolumeSpecName: "console-config") pod "1e34950e-8f40-452b-8b7a-17aab5025cdd" (UID: "1e34950e-8f40-452b-8b7a-17aab5025cdd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:36:18.084542 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.084424 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1e34950e-8f40-452b-8b7a-17aab5025cdd" (UID: "1e34950e-8f40-452b-8b7a-17aab5025cdd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:36:18.084542 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.084489 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1e34950e-8f40-452b-8b7a-17aab5025cdd" (UID: "1e34950e-8f40-452b-8b7a-17aab5025cdd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:36:18.085926 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.085899 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1e34950e-8f40-452b-8b7a-17aab5025cdd" (UID: "1e34950e-8f40-452b-8b7a-17aab5025cdd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:36:18.086144 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.086120 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1e34950e-8f40-452b-8b7a-17aab5025cdd" (UID: "1e34950e-8f40-452b-8b7a-17aab5025cdd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:36:18.086222 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.086159 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e34950e-8f40-452b-8b7a-17aab5025cdd-kube-api-access-vrt5k" (OuterVolumeSpecName: "kube-api-access-vrt5k") pod "1e34950e-8f40-452b-8b7a-17aab5025cdd" (UID: "1e34950e-8f40-452b-8b7a-17aab5025cdd"). InnerVolumeSpecName "kube-api-access-vrt5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:36:18.184960 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.184929 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-service-ca\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:36:18.184960 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.184955 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:36:18.184960 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.184965 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:36:18.185207 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.184974 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrt5k\" (UniqueName: \"kubernetes.io/projected/1e34950e-8f40-452b-8b7a-17aab5025cdd-kube-api-access-vrt5k\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:36:18.185207 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.185001 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-oauth-serving-cert\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:36:18.185207 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.185009 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e34950e-8f40-452b-8b7a-17aab5025cdd-trusted-ca-bundle\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:36:18.185207 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.185017 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e34950e-8f40-452b-8b7a-17aab5025cdd-console-oauth-config\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:36:18.793612 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.793580 2585 generic.go:356] "Generic (PLEG): container finished" podID="1e34950e-8f40-452b-8b7a-17aab5025cdd" containerID="02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf" exitCode=0 Sep 17 18:36:18.794062 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.793631 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c999f58c-gz22j" Sep 17 18:36:18.794062 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.793643 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c999f58c-gz22j" event={"ID":"1e34950e-8f40-452b-8b7a-17aab5025cdd","Type":"ContainerDied","Data":"02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf"} Sep 17 18:36:18.794062 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.793683 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c999f58c-gz22j" event={"ID":"1e34950e-8f40-452b-8b7a-17aab5025cdd","Type":"ContainerDied","Data":"030b5e798c5c31c5f005a40eeeb91add25e014e3f41fdc6eca6449ab0486fa0e"} Sep 17 18:36:18.794062 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.793702 2585 scope.go:117] "RemoveContainer" containerID="02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf" Sep 17 18:36:18.802566 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.802549 2585 scope.go:117] "RemoveContainer" containerID="02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf" Sep 17 18:36:18.802850 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:36:18.802831 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf\": container with ID starting with 02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf not found: ID does not exist" containerID="02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf" Sep 17 18:36:18.802909 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.802858 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf"} err="failed to get container status \"02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf\": rpc error: code = NotFound desc = could not find container \"02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf\": container with ID starting with 02b3f92cc8ccba9423b80fb330d94780d7d2b6c38db0fa7bb5db76f808fc7fcf not found: ID does not exist" Sep 17 18:36:18.815852 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.815829 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c999f58c-gz22j"] Sep 17 18:36:18.820193 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:18.820172 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c999f58c-gz22j"] Sep 17 18:36:20.004308 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:20.004276 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e34950e-8f40-452b-8b7a-17aab5025cdd" path="/var/lib/kubelet/pods/1e34950e-8f40-452b-8b7a-17aab5025cdd/volumes" Sep 17 18:36:25.874488 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.874456 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd"] Sep 17 18:36:25.875104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.874766 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e34950e-8f40-452b-8b7a-17aab5025cdd" containerName="console" Sep 17 18:36:25.875104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.874777 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e34950e-8f40-452b-8b7a-17aab5025cdd" containerName="console" Sep 17 18:36:25.875104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.874840 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e34950e-8f40-452b-8b7a-17aab5025cdd" containerName="console" Sep 17 18:36:25.877923 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.877907 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" Sep 17 18:36:25.880658 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.880635 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 17 18:36:25.880794 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.880692 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-d7t9t\"" Sep 17 18:36:25.880972 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.880955 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 18:36:25.881050 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.880963 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 18:36:25.893101 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.893081 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd"] Sep 17 18:36:25.956903 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:25.956879 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zngh5\" (UniqueName: \"kubernetes.io/projected/d637e772-47c1-4811-be69-0c8ba2d5403c-kube-api-access-zngh5\") pod \"dns-operator-controller-manager-65dc8f76f5-wlhqd\" (UID: \"d637e772-47c1-4811-be69-0c8ba2d5403c\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" Sep 17 18:36:26.057596 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:26.057553 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zngh5\" (UniqueName: \"kubernetes.io/projected/d637e772-47c1-4811-be69-0c8ba2d5403c-kube-api-access-zngh5\") pod \"dns-operator-controller-manager-65dc8f76f5-wlhqd\" (UID: \"d637e772-47c1-4811-be69-0c8ba2d5403c\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" Sep 17 18:36:26.069808 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:26.069789 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zngh5\" (UniqueName: \"kubernetes.io/projected/d637e772-47c1-4811-be69-0c8ba2d5403c-kube-api-access-zngh5\") pod \"dns-operator-controller-manager-65dc8f76f5-wlhqd\" (UID: \"d637e772-47c1-4811-be69-0c8ba2d5403c\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" Sep 17 18:36:26.187700 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:26.187633 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" Sep 17 18:36:26.463253 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:26.463233 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd"] Sep 17 18:36:26.465398 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:36:26.465368 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd637e772_47c1_4811_be69_0c8ba2d5403c.slice/crio-94d1bd3adb5ba9705e5e447d144a0c0ca87df6c63d53dffca1697f5647c75dc6 WatchSource:0}: Error finding container 94d1bd3adb5ba9705e5e447d144a0c0ca87df6c63d53dffca1697f5647c75dc6: Status 404 returned error can't find the container with id 94d1bd3adb5ba9705e5e447d144a0c0ca87df6c63d53dffca1697f5647c75dc6 Sep 17 18:36:26.786306 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:26.786199 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7594644fcd-ws5w6" Sep 17 18:36:26.828956 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:26.828917 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" event={"ID":"d637e772-47c1-4811-be69-0c8ba2d5403c","Type":"ContainerStarted","Data":"94d1bd3adb5ba9705e5e447d144a0c0ca87df6c63d53dffca1697f5647c75dc6"} Sep 17 18:36:29.846074 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:29.846034 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" event={"ID":"d637e772-47c1-4811-be69-0c8ba2d5403c","Type":"ContainerStarted","Data":"92682d89515fb8ecf12e152985bc5e3c900cfe5a4aeb05d78e7d69f1b431d564"} Sep 17 18:36:29.846436 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:29.846117 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" Sep 17 18:36:29.883084 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:29.883034 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" podStartSLOduration=1.96355156 podStartE2EDuration="4.883018731s" totalImagesPullingTime="2.919467171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:36:29.882022081 +0000 UTC m=+415.819410950" watchObservedRunningTime="2026-09-17 18:36:29.883018731 +0000 UTC m=+415.820407594" Sep 17 18:36:33.538294 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.538260 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp"] Sep 17 18:36:33.541474 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.541460 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:33.546392 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.546244 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tn8jt\"" Sep 17 18:36:33.575651 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.575620 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp"] Sep 17 18:36:33.625015 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.624967 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46a92f5a-6460-40b5-8f44-0c2e338d0e13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6d4cb79c-m25mp\" (UID: \"46a92f5a-6460-40b5-8f44-0c2e338d0e13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:33.625165 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.625095 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmsn5\" (UniqueName: \"kubernetes.io/projected/46a92f5a-6460-40b5-8f44-0c2e338d0e13-kube-api-access-xmsn5\") pod \"kuadrant-operator-controller-manager-6d4cb79c-m25mp\" (UID: \"46a92f5a-6460-40b5-8f44-0c2e338d0e13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:33.725943 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.725910 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46a92f5a-6460-40b5-8f44-0c2e338d0e13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6d4cb79c-m25mp\" (UID: \"46a92f5a-6460-40b5-8f44-0c2e338d0e13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:33.726107 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.726009 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmsn5\" (UniqueName: \"kubernetes.io/projected/46a92f5a-6460-40b5-8f44-0c2e338d0e13-kube-api-access-xmsn5\") pod \"kuadrant-operator-controller-manager-6d4cb79c-m25mp\" (UID: \"46a92f5a-6460-40b5-8f44-0c2e338d0e13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:33.726332 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.726310 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46a92f5a-6460-40b5-8f44-0c2e338d0e13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6d4cb79c-m25mp\" (UID: \"46a92f5a-6460-40b5-8f44-0c2e338d0e13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:33.738788 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.738759 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmsn5\" (UniqueName: \"kubernetes.io/projected/46a92f5a-6460-40b5-8f44-0c2e338d0e13-kube-api-access-xmsn5\") pod \"kuadrant-operator-controller-manager-6d4cb79c-m25mp\" (UID: \"46a92f5a-6460-40b5-8f44-0c2e338d0e13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:33.853687 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:33.853605 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:34.136305 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:34.136281 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp"] Sep 17 18:36:34.137851 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:36:34.137827 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a92f5a_6460_40b5_8f44_0c2e338d0e13.slice/crio-0addb57aea5ada0f2f2f7554b5ffb380decb7865508daddef80f81ab4a8cdce6 WatchSource:0}: Error finding container 0addb57aea5ada0f2f2f7554b5ffb380decb7865508daddef80f81ab4a8cdce6: Status 404 returned error can't find the container with id 0addb57aea5ada0f2f2f7554b5ffb380decb7865508daddef80f81ab4a8cdce6 Sep 17 18:36:34.868673 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:34.868640 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" event={"ID":"46a92f5a-6460-40b5-8f44-0c2e338d0e13","Type":"ContainerStarted","Data":"0addb57aea5ada0f2f2f7554b5ffb380decb7865508daddef80f81ab4a8cdce6"} Sep 17 18:36:38.891655 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:38.891623 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" event={"ID":"46a92f5a-6460-40b5-8f44-0c2e338d0e13","Type":"ContainerStarted","Data":"5ab73d087a4c830c8f8a53542d7258345bad6123a3be1e1160c8eabd2d484669"} Sep 17 18:36:38.892208 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:38.891809 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:36:38.922714 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:38.922659 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" podStartSLOduration=1.823574365 podStartE2EDuration="5.922643241s" totalImagesPullingTime="4.099068876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:36:38.920390822 +0000 UTC m=+424.857779691" watchObservedRunningTime="2026-09-17 18:36:38.922643241 +0000 UTC m=+424.860032106" Sep 17 18:36:40.475621 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.475589 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt"] Sep 17 18:36:40.479198 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.479170 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.482741 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.482712 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 17 18:36:40.482741 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.482732 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kl6rs\"" Sep 17 18:36:40.482914 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.482732 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 17 18:36:40.489492 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.489469 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt"] Sep 17 18:36:40.593104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.593067 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18510283-c528-4265-9f7b-6de8494837db-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.593104 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.593104 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgtv9\" (UniqueName: \"kubernetes.io/projected/18510283-c528-4265-9f7b-6de8494837db-kube-api-access-kgtv9\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.593360 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.593192 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18510283-c528-4265-9f7b-6de8494837db-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.693889 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.693854 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18510283-c528-4265-9f7b-6de8494837db-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.693889 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.693887 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgtv9\" (UniqueName: \"kubernetes.io/projected/18510283-c528-4265-9f7b-6de8494837db-kube-api-access-kgtv9\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.694126 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.694029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18510283-c528-4265-9f7b-6de8494837db-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.694521 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.694501 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18510283-c528-4265-9f7b-6de8494837db-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.696463 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.696438 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18510283-c528-4265-9f7b-6de8494837db-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.702515 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.702497 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgtv9\" (UniqueName: \"kubernetes.io/projected/18510283-c528-4265-9f7b-6de8494837db-kube-api-access-kgtv9\") pod \"kuadrant-console-plugin-fbdd4f445-gq2bt\" (UID: \"18510283-c528-4265-9f7b-6de8494837db\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.789753 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.789733 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" Sep 17 18:36:40.853167 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:40.853140 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-wlhqd" Sep 17 18:36:41.058548 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:41.058393 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt"] Sep 17 18:36:41.060629 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:36:41.060603 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18510283_c528_4265_9f7b_6de8494837db.slice/crio-b037132c7650fe2583169c030531dc5523f5529fd670bd87260b98e466d0d5a9 WatchSource:0}: Error finding container b037132c7650fe2583169c030531dc5523f5529fd670bd87260b98e466d0d5a9: Status 404 returned error can't find the container with id b037132c7650fe2583169c030531dc5523f5529fd670bd87260b98e466d0d5a9 Sep 17 18:36:41.908785 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:41.908745 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" event={"ID":"18510283-c528-4265-9f7b-6de8494837db","Type":"ContainerStarted","Data":"b037132c7650fe2583169c030531dc5523f5529fd670bd87260b98e466d0d5a9"} Sep 17 18:36:45.932337 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:45.932243 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" event={"ID":"18510283-c528-4265-9f7b-6de8494837db","Type":"ContainerStarted","Data":"50a2ede5ae71e6e798c0560801a6879663d0cfac860c6039f17f68ca478598ac"} Sep 17 18:36:45.963138 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:45.963092 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-gq2bt" podStartSLOduration=1.441047094 podStartE2EDuration="5.963073572s" totalImagesPullingTime="4.522026478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:36:45.962087833 +0000 UTC m=+431.899476700" watchObservedRunningTime="2026-09-17 18:36:45.963073572 +0000 UTC m=+431.900462439" Sep 17 18:36:49.898453 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:36:49.898380 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6d4cb79c-m25mp" Sep 17 18:37:20.933109 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:20.933067 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l5d4x"] Sep 17 18:37:20.936313 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:20.936293 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:20.939652 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:20.939633 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 18:37:20.947307 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:20.947285 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l5d4x"] Sep 17 18:37:21.030967 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.030939 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l5d4x"] Sep 17 18:37:21.049427 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.049399 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9jb\" (UniqueName: \"kubernetes.io/projected/ef8e9921-db34-496e-8e47-120a15150d76-kube-api-access-jp9jb\") pod \"limitador-limitador-8588749977-l5d4x\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:21.049579 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.049493 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef8e9921-db34-496e-8e47-120a15150d76-config-file\") pod \"limitador-limitador-8588749977-l5d4x\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:21.149971 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.149935 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef8e9921-db34-496e-8e47-120a15150d76-config-file\") pod \"limitador-limitador-8588749977-l5d4x\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:21.149971 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.149993 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9jb\" (UniqueName: \"kubernetes.io/projected/ef8e9921-db34-496e-8e47-120a15150d76-kube-api-access-jp9jb\") pod \"limitador-limitador-8588749977-l5d4x\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:21.150751 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.150730 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef8e9921-db34-496e-8e47-120a15150d76-config-file\") pod \"limitador-limitador-8588749977-l5d4x\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:21.160192 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.160164 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9jb\" (UniqueName: \"kubernetes.io/projected/ef8e9921-db34-496e-8e47-120a15150d76-kube-api-access-jp9jb\") pod \"limitador-limitador-8588749977-l5d4x\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:21.245874 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.245795 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:21.516955 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:21.516929 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l5d4x"] Sep 17 18:37:21.518691 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:37:21.518656 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8e9921_db34_496e_8e47_120a15150d76.slice/crio-732bfb8193a8cd7b17f25b692a636c9ce29750ad64f0217191a4f0e7fa4b4c07 WatchSource:0}: Error finding container 732bfb8193a8cd7b17f25b692a636c9ce29750ad64f0217191a4f0e7fa4b4c07: Status 404 returned error can't find the container with id 732bfb8193a8cd7b17f25b692a636c9ce29750ad64f0217191a4f0e7fa4b4c07 Sep 17 18:37:22.090413 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:22.090377 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" event={"ID":"ef8e9921-db34-496e-8e47-120a15150d76","Type":"ContainerStarted","Data":"732bfb8193a8cd7b17f25b692a636c9ce29750ad64f0217191a4f0e7fa4b4c07"} Sep 17 18:37:24.101744 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:24.101700 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" event={"ID":"ef8e9921-db34-496e-8e47-120a15150d76","Type":"ContainerStarted","Data":"9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e"} Sep 17 18:37:24.102144 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:24.101787 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:24.121172 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:24.121120 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" podStartSLOduration=2.507016758 podStartE2EDuration="4.121105168s" totalImagesPullingTime="1.61408841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:37:24.120181579 +0000 UTC m=+470.057570445" watchObservedRunningTime="2026-09-17 18:37:24.121105168 +0000 UTC m=+470.058494033" Sep 17 18:37:35.021342 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.021296 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l5d4x"] Sep 17 18:37:35.021727 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.021480 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" podUID="ef8e9921-db34-496e-8e47-120a15150d76" containerName="limitador" containerID="cri-o://9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e" gracePeriod=30 Sep 17 18:37:35.022188 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.022170 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:35.562960 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.562939 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:35.660788 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.660719 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef8e9921-db34-496e-8e47-120a15150d76-config-file\") pod \"ef8e9921-db34-496e-8e47-120a15150d76\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " Sep 17 18:37:35.660788 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.660763 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp9jb\" (UniqueName: \"kubernetes.io/projected/ef8e9921-db34-496e-8e47-120a15150d76-kube-api-access-jp9jb\") pod \"ef8e9921-db34-496e-8e47-120a15150d76\" (UID: \"ef8e9921-db34-496e-8e47-120a15150d76\") " Sep 17 18:37:35.661095 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.661075 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e9921-db34-496e-8e47-120a15150d76-config-file" (OuterVolumeSpecName: "config-file") pod "ef8e9921-db34-496e-8e47-120a15150d76" (UID: "ef8e9921-db34-496e-8e47-120a15150d76"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:37:35.662830 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.662809 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8e9921-db34-496e-8e47-120a15150d76-kube-api-access-jp9jb" (OuterVolumeSpecName: "kube-api-access-jp9jb") pod "ef8e9921-db34-496e-8e47-120a15150d76" (UID: "ef8e9921-db34-496e-8e47-120a15150d76"). InnerVolumeSpecName "kube-api-access-jp9jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:37:35.762084 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.762055 2585 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef8e9921-db34-496e-8e47-120a15150d76-config-file\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:37:35.762084 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:35.762077 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp9jb\" (UniqueName: \"kubernetes.io/projected/ef8e9921-db34-496e-8e47-120a15150d76-kube-api-access-jp9jb\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:37:36.157028 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.156975 2585 generic.go:356] "Generic (PLEG): container finished" podID="ef8e9921-db34-496e-8e47-120a15150d76" containerID="9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e" exitCode=0 Sep 17 18:37:36.157028 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.157016 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" event={"ID":"ef8e9921-db34-496e-8e47-120a15150d76","Type":"ContainerDied","Data":"9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e"} Sep 17 18:37:36.157503 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.157061 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" Sep 17 18:37:36.157503 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.157078 2585 scope.go:117] "RemoveContainer" containerID="9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e" Sep 17 18:37:36.157503 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.157068 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l5d4x" event={"ID":"ef8e9921-db34-496e-8e47-120a15150d76","Type":"ContainerDied","Data":"732bfb8193a8cd7b17f25b692a636c9ce29750ad64f0217191a4f0e7fa4b4c07"} Sep 17 18:37:36.165293 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.165278 2585 scope.go:117] "RemoveContainer" containerID="9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e" Sep 17 18:37:36.165582 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:37:36.165565 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e\": container with ID starting with 9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e not found: ID does not exist" containerID="9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e" Sep 17 18:37:36.165652 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.165594 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e"} err="failed to get container status \"9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e\": rpc error: code = NotFound desc = could not find container \"9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e\": container with ID starting with 9cacc3e5252a6cfb557f57d2f07ea3eef7dd730f4fabe1fac5c6a9a8ac803c9e not found: ID does not exist" Sep 17 18:37:36.174420 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.174395 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l5d4x"] Sep 17 18:37:36.179519 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:36.179497 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l5d4x"] Sep 17 18:37:38.005096 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:37:38.005068 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef8e9921-db34-496e-8e47-120a15150d76" path="/var/lib/kubelet/pods/ef8e9921-db34-496e-8e47-120a15150d76/volumes" Sep 17 18:38:03.704369 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.704330 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff"] Sep 17 18:38:03.704842 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.704705 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e9921-db34-496e-8e47-120a15150d76" containerName="limitador" Sep 17 18:38:03.704842 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.704717 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e9921-db34-496e-8e47-120a15150d76" containerName="limitador" Sep 17 18:38:03.704842 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.704776 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8e9921-db34-496e-8e47-120a15150d76" containerName="limitador" Sep 17 18:38:03.708788 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.708768 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.711975 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.711949 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 18:38:03.711975 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.711966 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 17 18:38:03.711975 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.711977 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 18:38:03.712225 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.712030 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 17 18:38:03.712225 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.711949 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 17 18:38:03.712225 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.712116 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gw57w\"" Sep 17 18:38:03.712350 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.712340 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 17 18:38:03.725290 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.725263 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff"] Sep 17 18:38:03.807601 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.807567 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.807601 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.807606 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh675\" (UniqueName: \"kubernetes.io/projected/ad5f9be6-2360-44d8-bf07-b84f42726540-kube-api-access-qh675\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.807879 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.807629 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.807879 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.807754 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad5f9be6-2360-44d8-bf07-b84f42726540-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.807879 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.807802 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.807879 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.807831 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.807879 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.807865 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.908713 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.908674 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.908713 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.908717 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh675\" (UniqueName: \"kubernetes.io/projected/ad5f9be6-2360-44d8-bf07-b84f42726540-kube-api-access-qh675\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.908965 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.908862 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.908965 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.908938 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad5f9be6-2360-44d8-bf07-b84f42726540-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.909117 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.908968 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.909117 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.909021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.909363 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.909328 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.910025 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.909958 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.911789 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.911654 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad5f9be6-2360-44d8-bf07-b84f42726540-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.911910 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.911889 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.912274 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.912193 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.913034 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.912968 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.927017 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.926940 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh675\" (UniqueName: \"kubernetes.io/projected/ad5f9be6-2360-44d8-bf07-b84f42726540-kube-api-access-qh675\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:03.927735 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:03.927710 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad5f9be6-2360-44d8-bf07-b84f42726540-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2lnff\" (UID: \"ad5f9be6-2360-44d8-bf07-b84f42726540\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:04.017795 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:04.017715 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:04.303443 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:04.303417 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff"] Sep 17 18:38:04.305291 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:38:04.305267 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5f9be6_2360_44d8_bf07_b84f42726540.slice/crio-f78798d73b8e67c20dd3ce773860557fa0143be52df397318f96034a4be76777 WatchSource:0}: Error finding container f78798d73b8e67c20dd3ce773860557fa0143be52df397318f96034a4be76777: Status 404 returned error can't find the container with id f78798d73b8e67c20dd3ce773860557fa0143be52df397318f96034a4be76777 Sep 17 18:38:05.296129 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:05.296090 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" event={"ID":"ad5f9be6-2360-44d8-bf07-b84f42726540","Type":"ContainerStarted","Data":"f78798d73b8e67c20dd3ce773860557fa0143be52df397318f96034a4be76777"} Sep 17 18:38:13.792345 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:13.792306 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 18:38:13.792750 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:13.792387 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 18:38:14.342333 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:14.342295 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" event={"ID":"ad5f9be6-2360-44d8-bf07-b84f42726540","Type":"ContainerStarted","Data":"f6ab531a26fa643d81a2328d181c438cf0fe3dd247a93cca3a37e44adf78646a"} Sep 17 18:38:14.342607 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:14.342477 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:38:14.344148 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:14.344122 2585 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-2lnff container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 17 18:38:14.344251 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:14.344171 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" podUID="ad5f9be6-2360-44d8-bf07-b84f42726540" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 18:38:14.367300 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:14.367247 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" podStartSLOduration=1.88259943 podStartE2EDuration="11.3672273s" totalImagesPullingTime="9.48462787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:38:14.364692116 +0000 UTC m=+520.302080982" watchObservedRunningTime="2026-09-17 18:38:14.3672273 +0000 UTC m=+520.304616168" Sep 17 18:38:15.347862 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:38:15.347834 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lnff" Sep 17 18:39:35.973146 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:39:35.973119 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:39:35.974080 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:39:35.974059 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:44:36.006522 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:44:36.006443 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:44:36.007096 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:44:36.006757 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:49:36.035349 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:49:36.035318 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:49:36.036592 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:49:36.036566 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:54:36.064468 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:54:36.064435 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:54:36.065974 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:54:36.065946 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:55:21.952813 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.952733 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9"] Sep 17 18:55:21.956821 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.956797 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:21.961633 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.961605 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"openshift-service-ca.crt\"" Sep 17 18:55:21.962573 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.962551 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-kserve-self-signed-certs\"" Sep 17 18:55:21.962807 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.962788 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"kube-root-ca.crt\"" Sep 17 18:55:21.962992 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.962954 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-epp-sa-dockercfg-ttkqf\"" Sep 17 18:55:21.963769 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.963740 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"default-dockercfg-fl45c\"" Sep 17 18:55:21.972853 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:21.972822 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9"] Sep 17 18:55:22.004879 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.004845 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76k7q\" (UniqueName: \"kubernetes.io/projected/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-kube-api-access-76k7q\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:22.004879 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.004880 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:22.106040 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.105972 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76k7q\" (UniqueName: \"kubernetes.io/projected/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-kube-api-access-76k7q\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:22.106040 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.106042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:22.108645 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.108611 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:22.116256 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.116228 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76k7q\" (UniqueName: \"kubernetes.io/projected/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-kube-api-access-76k7q\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:22.273968 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.273873 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:22.552938 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.552872 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9"] Sep 17 18:55:22.556025 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:55:22.555969 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c03ff60_3f71_4d69_89a4_bb2085dddd2e.slice/crio-b61c860d360d3f5fd4d160876f3acf16cb5eb741a0ee3228fec5b6c3cb66f411 WatchSource:0}: Error finding container b61c860d360d3f5fd4d160876f3acf16cb5eb741a0ee3228fec5b6c3cb66f411: Status 404 returned error can't find the container with id b61c860d360d3f5fd4d160876f3acf16cb5eb741a0ee3228fec5b6c3cb66f411 Sep 17 18:55:22.558522 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:22.558500 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:55:23.070346 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:23.070301 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" event={"ID":"7c03ff60-3f71-4d69-89a4-bb2085dddd2e","Type":"ContainerStarted","Data":"b61c860d360d3f5fd4d160876f3acf16cb5eb741a0ee3228fec5b6c3cb66f411"} Sep 17 18:55:26.090474 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:26.090438 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" event={"ID":"7c03ff60-3f71-4d69-89a4-bb2085dddd2e","Type":"ContainerStarted","Data":"142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596"} Sep 17 18:55:26.090973 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:26.090567 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:55:26.113954 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:26.113902 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" podStartSLOduration=2.648572405 podStartE2EDuration="5.113883283s" totalImagesPullingTime="2.465310878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:55:26.112852816 +0000 UTC m=+1552.050241673" watchObservedRunningTime="2026-09-17 18:55:26.113883283 +0000 UTC m=+1552.051272150" Sep 17 18:55:57.096421 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:55:57.096391 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:56:00.889654 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:00.889619 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9"] Sep 17 18:56:07.096663 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:07.096626 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:56:15.908745 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:15.908683 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" containerID="cri-o://142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596" gracePeriod=45 Sep 17 18:56:17.097186 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:17.097148 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:56:27.097343 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:27.097256 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:56:27.097722 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:27.097365 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:56:37.096611 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:37.096568 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:56:46.158721 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.158691 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:56:46.268380 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.268266 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-tls-certs\") pod \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " Sep 17 18:56:46.268380 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.268341 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76k7q\" (UniqueName: \"kubernetes.io/projected/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-kube-api-access-76k7q\") pod \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\" (UID: \"7c03ff60-3f71-4d69-89a4-bb2085dddd2e\") " Sep 17 18:56:46.270529 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.270496 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c03ff60-3f71-4d69-89a4-bb2085dddd2e" (UID: "7c03ff60-3f71-4d69-89a4-bb2085dddd2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:56:46.270658 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.270551 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-kube-api-access-76k7q" (OuterVolumeSpecName: "kube-api-access-76k7q") pod "7c03ff60-3f71-4d69-89a4-bb2085dddd2e" (UID: "7c03ff60-3f71-4d69-89a4-bb2085dddd2e"). InnerVolumeSpecName "kube-api-access-76k7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:56:46.369294 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.369237 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-tls-certs\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:56:46.369294 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.369287 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76k7q\" (UniqueName: \"kubernetes.io/projected/7c03ff60-3f71-4d69-89a4-bb2085dddd2e-kube-api-access-76k7q\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:56:46.471750 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.471715 2585 generic.go:356] "Generic (PLEG): container finished" podID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerID="142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596" exitCode=0 Sep 17 18:56:46.471920 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.471776 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" Sep 17 18:56:46.471920 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.471796 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" event={"ID":"7c03ff60-3f71-4d69-89a4-bb2085dddd2e","Type":"ContainerDied","Data":"142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596"} Sep 17 18:56:46.471920 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.471871 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9" event={"ID":"7c03ff60-3f71-4d69-89a4-bb2085dddd2e","Type":"ContainerDied","Data":"b61c860d360d3f5fd4d160876f3acf16cb5eb741a0ee3228fec5b6c3cb66f411"} Sep 17 18:56:46.471920 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.471893 2585 scope.go:117] "RemoveContainer" containerID="142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596" Sep 17 18:56:46.480875 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.480853 2585 scope.go:117] "RemoveContainer" containerID="142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596" Sep 17 18:56:46.481175 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:56:46.481156 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596\": container with ID starting with 142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596 not found: ID does not exist" containerID="142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596" Sep 17 18:56:46.481224 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.481184 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596"} err="failed to get container status \"142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596\": rpc error: code = NotFound desc = could not find container \"142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596\": container with ID starting with 142edd49d14fdafd034f8b6dd99ebad007e51eaf2b0e23909fb3ecc859358596 not found: ID does not exist" Sep 17 18:56:46.508952 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.508918 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9"] Sep 17 18:56:46.514816 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:46.514787 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7dldzv9"] Sep 17 18:56:48.005563 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:56:48.005526 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" path="/var/lib/kubelet/pods/7c03ff60-3f71-4d69-89a4-bb2085dddd2e/volumes" Sep 17 18:57:01.282001 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.281951 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf"] Sep 17 18:57:01.282516 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.282496 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" Sep 17 18:57:01.282609 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.282519 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" Sep 17 18:57:01.282659 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.282617 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c03ff60-3f71-4d69-89a4-bb2085dddd2e" containerName="main" Sep 17 18:57:01.285656 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.285633 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.289076 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.289047 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-m75lq\"" Sep 17 18:57:01.290276 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.290250 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"kube-root-ca.crt\"" Sep 17 18:57:01.290276 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.290263 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\"" Sep 17 18:57:01.290515 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.290500 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"openshift-service-ca.crt\"" Sep 17 18:57:01.290587 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.290560 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"default-dockercfg-zww98\"" Sep 17 18:57:01.296834 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.296800 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf"] Sep 17 18:57:01.402771 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.402735 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba36465-25f9-4f99-9b89-946f3aebea75-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.402998 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.402797 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzzl\" (UniqueName: \"kubernetes.io/projected/eba36465-25f9-4f99-9b89-946f3aebea75-kube-api-access-ndzzl\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.503553 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.503511 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba36465-25f9-4f99-9b89-946f3aebea75-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.503769 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.503568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzzl\" (UniqueName: \"kubernetes.io/projected/eba36465-25f9-4f99-9b89-946f3aebea75-kube-api-access-ndzzl\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.506128 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.506104 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba36465-25f9-4f99-9b89-946f3aebea75-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.512642 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.512603 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzzl\" (UniqueName: \"kubernetes.io/projected/eba36465-25f9-4f99-9b89-946f3aebea75-kube-api-access-ndzzl\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.597848 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.597816 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:01.873909 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:01.873754 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf"] Sep 17 18:57:01.876788 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:57:01.876758 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba36465_25f9_4f99_9b89_946f3aebea75.slice/crio-b350667d9b16e9c105daa769aeda8bb874816abb681c1963147fb92142b04d60 WatchSource:0}: Error finding container b350667d9b16e9c105daa769aeda8bb874816abb681c1963147fb92142b04d60: Status 404 returned error can't find the container with id b350667d9b16e9c105daa769aeda8bb874816abb681c1963147fb92142b04d60 Sep 17 18:57:02.547802 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:02.547747 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" event={"ID":"eba36465-25f9-4f99-9b89-946f3aebea75","Type":"ContainerStarted","Data":"3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722"} Sep 17 18:57:02.548299 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:02.547854 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" event={"ID":"eba36465-25f9-4f99-9b89-946f3aebea75","Type":"ContainerStarted","Data":"b350667d9b16e9c105daa769aeda8bb874816abb681c1963147fb92142b04d60"} Sep 17 18:57:02.548299 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:02.547881 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:02.577434 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:02.577379 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" podStartSLOduration=1.577361191 podStartE2EDuration="1.577361191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:57:02.576579441 +0000 UTC m=+1648.513968307" watchObservedRunningTime="2026-09-17 18:57:02.577361191 +0000 UTC m=+1648.514750057" Sep 17 18:57:33.555128 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:33.555096 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:57:35.071010 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:35.070966 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf"] Sep 17 18:57:43.555147 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:43.555109 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:57:50.091035 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:50.090937 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" containerID="cri-o://3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722" gracePeriod=45 Sep 17 18:57:53.555478 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:57:53.555442 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:58:03.555473 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:03.555434 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:58:03.555860 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:03.555540 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:58:13.555629 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:13.555590 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 18:58:20.337000 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.336956 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:58:20.407903 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.407813 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba36465-25f9-4f99-9b89-946f3aebea75-tls-certs\") pod \"eba36465-25f9-4f99-9b89-946f3aebea75\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " Sep 17 18:58:20.407903 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.407856 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndzzl\" (UniqueName: \"kubernetes.io/projected/eba36465-25f9-4f99-9b89-946f3aebea75-kube-api-access-ndzzl\") pod \"eba36465-25f9-4f99-9b89-946f3aebea75\" (UID: \"eba36465-25f9-4f99-9b89-946f3aebea75\") " Sep 17 18:58:20.410183 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.410160 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba36465-25f9-4f99-9b89-946f3aebea75-kube-api-access-ndzzl" (OuterVolumeSpecName: "kube-api-access-ndzzl") pod "eba36465-25f9-4f99-9b89-946f3aebea75" (UID: "eba36465-25f9-4f99-9b89-946f3aebea75"). InnerVolumeSpecName "kube-api-access-ndzzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:58:20.410290 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.410181 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba36465-25f9-4f99-9b89-946f3aebea75-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eba36465-25f9-4f99-9b89-946f3aebea75" (UID: "eba36465-25f9-4f99-9b89-946f3aebea75"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:58:20.509183 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.509142 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba36465-25f9-4f99-9b89-946f3aebea75-tls-certs\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:58:20.509183 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.509175 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndzzl\" (UniqueName: \"kubernetes.io/projected/eba36465-25f9-4f99-9b89-946f3aebea75-kube-api-access-ndzzl\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 18:58:20.930863 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.930827 2585 generic.go:356] "Generic (PLEG): container finished" podID="eba36465-25f9-4f99-9b89-946f3aebea75" containerID="3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722" exitCode=0 Sep 17 18:58:20.931066 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.930871 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" Sep 17 18:58:20.931066 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.930875 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" event={"ID":"eba36465-25f9-4f99-9b89-946f3aebea75","Type":"ContainerDied","Data":"3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722"} Sep 17 18:58:20.931066 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.930927 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf" event={"ID":"eba36465-25f9-4f99-9b89-946f3aebea75","Type":"ContainerDied","Data":"b350667d9b16e9c105daa769aeda8bb874816abb681c1963147fb92142b04d60"} Sep 17 18:58:20.931066 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.930959 2585 scope.go:117] "RemoveContainer" containerID="3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722" Sep 17 18:58:20.940685 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.940666 2585 scope.go:117] "RemoveContainer" containerID="3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722" Sep 17 18:58:20.940960 ip-10-0-138-98 kubenswrapper[2585]: E0917 18:58:20.940942 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722\": container with ID starting with 3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722 not found: ID does not exist" containerID="3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722" Sep 17 18:58:20.941045 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.940971 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722"} err="failed to get container status \"3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722\": rpc error: code = NotFound desc = could not find container \"3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722\": container with ID starting with 3e2760283242bca0c5eb1b486699ae67eb76e43dcffcee61d24274e32749e722 not found: ID does not exist" Sep 17 18:58:20.953307 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.953276 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf"] Sep 17 18:58:20.958131 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:20.958107 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche67lkf"] Sep 17 18:58:22.009173 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:58:22.006950 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" path="/var/lib/kubelet/pods/eba36465-25f9-4f99-9b89-946f3aebea75/volumes" Sep 17 18:59:36.098904 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:36.098877 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:59:36.102345 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:36.102321 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 18:59:43.836028 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.835997 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4"] Sep 17 18:59:43.836394 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.836358 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" Sep 17 18:59:43.836394 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.836369 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" Sep 17 18:59:43.836463 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.836423 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="eba36465-25f9-4f99-9b89-946f3aebea75" containerName="main" Sep 17 18:59:43.839419 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.839403 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:43.845668 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.845640 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\"" Sep 17 18:59:43.845836 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.845790 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\"" Sep 17 18:59:43.846260 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.845870 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-wlg4n\"" Sep 17 18:59:43.846260 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.845795 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-jxjct\"" Sep 17 18:59:43.846260 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.846078 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\"" Sep 17 18:59:43.861727 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.861696 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p695s\" (UniqueName: \"kubernetes.io/projected/51012133-6f71-4d41-84ee-d9b80a0f9758-kube-api-access-p695s\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:43.861919 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.861746 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51012133-6f71-4d41-84ee-d9b80a0f9758-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:43.938497 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.938459 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4"] Sep 17 18:59:43.962417 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.962382 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p695s\" (UniqueName: \"kubernetes.io/projected/51012133-6f71-4d41-84ee-d9b80a0f9758-kube-api-access-p695s\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:43.962580 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.962433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51012133-6f71-4d41-84ee-d9b80a0f9758-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:43.965087 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.965057 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51012133-6f71-4d41-84ee-d9b80a0f9758-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:43.975324 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:43.975298 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p695s\" (UniqueName: \"kubernetes.io/projected/51012133-6f71-4d41-84ee-d9b80a0f9758-kube-api-access-p695s\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:44.150033 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:44.149922 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:44.430530 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:44.430452 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4"] Sep 17 18:59:44.432854 ip-10-0-138-98 kubenswrapper[2585]: W0917 18:59:44.432823 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51012133_6f71_4d41_84ee_d9b80a0f9758.slice/crio-4c7c6bd4badfed859889315abe5f517774b7cb167c23be60332c1b0445262ce9 WatchSource:0}: Error finding container 4c7c6bd4badfed859889315abe5f517774b7cb167c23be60332c1b0445262ce9: Status 404 returned error can't find the container with id 4c7c6bd4badfed859889315abe5f517774b7cb167c23be60332c1b0445262ce9 Sep 17 18:59:45.323797 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:45.323748 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" event={"ID":"51012133-6f71-4d41-84ee-d9b80a0f9758","Type":"ContainerStarted","Data":"96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4"} Sep 17 18:59:45.324322 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:45.323826 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" event={"ID":"51012133-6f71-4d41-84ee-d9b80a0f9758","Type":"ContainerStarted","Data":"4c7c6bd4badfed859889315abe5f517774b7cb167c23be60332c1b0445262ce9"} Sep 17 18:59:45.324322 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:45.323857 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 18:59:45.347210 ip-10-0-138-98 kubenswrapper[2585]: I0917 18:59:45.347136 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" podStartSLOduration=2.347113222 podStartE2EDuration="2.347113222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:59:45.344456915 +0000 UTC m=+1811.281845776" watchObservedRunningTime="2026-09-17 18:59:45.347113222 +0000 UTC m=+1811.284502089" Sep 17 19:00:16.330818 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:16.330785 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 19:00:18.065997 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:18.065955 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4"] Sep 17 19:00:26.331575 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:26.331510 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:00:33.086042 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:33.085968 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" containerID="cri-o://96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4" gracePeriod=45 Sep 17 19:00:36.330821 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:36.330779 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:00:46.330943 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:46.330907 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:00:46.331361 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:46.331059 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 19:00:56.331408 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:00:56.331374 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:01:03.331214 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.331189 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 19:01:03.484512 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.484422 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p695s\" (UniqueName: \"kubernetes.io/projected/51012133-6f71-4d41-84ee-d9b80a0f9758-kube-api-access-p695s\") pod \"51012133-6f71-4d41-84ee-d9b80a0f9758\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " Sep 17 19:01:03.484512 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.484474 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51012133-6f71-4d41-84ee-d9b80a0f9758-tls-certs\") pod \"51012133-6f71-4d41-84ee-d9b80a0f9758\" (UID: \"51012133-6f71-4d41-84ee-d9b80a0f9758\") " Sep 17 19:01:03.486396 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.486371 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51012133-6f71-4d41-84ee-d9b80a0f9758-kube-api-access-p695s" (OuterVolumeSpecName: "kube-api-access-p695s") pod "51012133-6f71-4d41-84ee-d9b80a0f9758" (UID: "51012133-6f71-4d41-84ee-d9b80a0f9758"). InnerVolumeSpecName "kube-api-access-p695s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:01:03.486544 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.486524 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51012133-6f71-4d41-84ee-d9b80a0f9758-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51012133-6f71-4d41-84ee-d9b80a0f9758" (UID: "51012133-6f71-4d41-84ee-d9b80a0f9758"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:01:03.585270 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.585235 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p695s\" (UniqueName: \"kubernetes.io/projected/51012133-6f71-4d41-84ee-d9b80a0f9758-kube-api-access-p695s\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:01:03.585270 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.585264 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51012133-6f71-4d41-84ee-d9b80a0f9758-tls-certs\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:01:03.683734 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.683700 2585 generic.go:356] "Generic (PLEG): container finished" podID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerID="96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4" exitCode=0 Sep 17 19:01:03.683905 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.683743 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" Sep 17 19:01:03.683905 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.683783 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" event={"ID":"51012133-6f71-4d41-84ee-d9b80a0f9758","Type":"ContainerDied","Data":"96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4"} Sep 17 19:01:03.683905 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.683839 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4" event={"ID":"51012133-6f71-4d41-84ee-d9b80a0f9758","Type":"ContainerDied","Data":"4c7c6bd4badfed859889315abe5f517774b7cb167c23be60332c1b0445262ce9"} Sep 17 19:01:03.683905 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.683866 2585 scope.go:117] "RemoveContainer" containerID="96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4" Sep 17 19:01:03.692830 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.692809 2585 scope.go:117] "RemoveContainer" containerID="96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4" Sep 17 19:01:03.693112 ip-10-0-138-98 kubenswrapper[2585]: E0917 19:01:03.693094 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4\": container with ID starting with 96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4 not found: ID does not exist" containerID="96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4" Sep 17 19:01:03.693180 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.693121 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4"} err="failed to get container status \"96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4\": rpc error: code = NotFound desc = could not find container \"96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4\": container with ID starting with 96346cb649b7405bc5cd461864df54445fd62156e0a0ca7f35e18d96e0994fe4 not found: ID does not exist" Sep 17 19:01:03.708897 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.708873 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4"] Sep 17 19:01:03.712208 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:03.712165 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schev5sm4"] Sep 17 19:01:04.005074 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:01:04.005044 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" path="/var/lib/kubelet/pods/51012133-6f71-4d41-84ee-d9b80a0f9758/volumes" Sep 17 19:02:07.433567 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.433532 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4"] Sep 17 19:02:07.434084 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.434067 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" Sep 17 19:02:07.434084 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.434085 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" Sep 17 19:02:07.434169 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.434162 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="51012133-6f71-4d41-84ee-d9b80a0f9758" containerName="main" Sep 17 19:02:07.437201 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.437184 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:07.441414 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.441388 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-8m6kk\"" Sep 17 19:02:07.441526 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.441388 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\"" Sep 17 19:02:07.441526 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.441441 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\"" Sep 17 19:02:07.444423 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.444401 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\"" Sep 17 19:02:07.444543 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.444498 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-x96g4\"" Sep 17 19:02:07.460051 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.460018 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4"] Sep 17 19:02:07.556131 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.556088 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47dcd\" (UniqueName: \"kubernetes.io/projected/27e9ff94-f725-4d4d-a987-182faa83690b-kube-api-access-47dcd\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:07.556308 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.556221 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27e9ff94-f725-4d4d-a987-182faa83690b-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:07.657143 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.657095 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47dcd\" (UniqueName: \"kubernetes.io/projected/27e9ff94-f725-4d4d-a987-182faa83690b-kube-api-access-47dcd\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:07.657356 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.657191 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27e9ff94-f725-4d4d-a987-182faa83690b-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:07.659657 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.659632 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27e9ff94-f725-4d4d-a987-182faa83690b-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:07.665841 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.665819 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47dcd\" (UniqueName: \"kubernetes.io/projected/27e9ff94-f725-4d4d-a987-182faa83690b-kube-api-access-47dcd\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:07.747560 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:07.747467 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:08.042414 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:08.042386 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4"] Sep 17 19:02:08.045138 ip-10-0-138-98 kubenswrapper[2585]: W0917 19:02:08.045094 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e9ff94_f725_4d4d_a987_182faa83690b.slice/crio-d58e638544a1fd0bd90730ede724480f1448743c79c5aaa50012341512c132d4 WatchSource:0}: Error finding container d58e638544a1fd0bd90730ede724480f1448743c79c5aaa50012341512c132d4: Status 404 returned error can't find the container with id d58e638544a1fd0bd90730ede724480f1448743c79c5aaa50012341512c132d4 Sep 17 19:02:08.983565 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:08.983531 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" event={"ID":"27e9ff94-f725-4d4d-a987-182faa83690b","Type":"ContainerStarted","Data":"3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f"} Sep 17 19:02:08.983977 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:08.983587 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" event={"ID":"27e9ff94-f725-4d4d-a987-182faa83690b","Type":"ContainerStarted","Data":"d58e638544a1fd0bd90730ede724480f1448743c79c5aaa50012341512c132d4"} Sep 17 19:02:08.983977 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:08.983615 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:02:09.011035 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:09.010957 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" podStartSLOduration=2.010943369 podStartE2EDuration="2.010943369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:02:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:02:09.007326373 +0000 UTC m=+1954.944715241" watchObservedRunningTime="2026-09-17 19:02:09.010943369 +0000 UTC m=+1954.948332234" Sep 17 19:02:39.990783 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:02:39.990708 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:04:23.041719 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:23.041635 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4"] Sep 17 19:04:29.991134 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:29.991093 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:04:36.130686 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:36.130661 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:04:36.135251 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:36.135230 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:04:38.061449 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:38.061402 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" containerID="cri-o://3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f" gracePeriod=45 Sep 17 19:04:39.991084 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:39.991046 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:04:49.991146 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:49.991106 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:04:49.991516 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:49.991244 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:04:59.990855 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:04:59.990819 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:05:08.316553 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.316525 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:05:08.399478 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.399382 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47dcd\" (UniqueName: \"kubernetes.io/projected/27e9ff94-f725-4d4d-a987-182faa83690b-kube-api-access-47dcd\") pod \"27e9ff94-f725-4d4d-a987-182faa83690b\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " Sep 17 19:05:08.399478 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.399431 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27e9ff94-f725-4d4d-a987-182faa83690b-tls-certs\") pod \"27e9ff94-f725-4d4d-a987-182faa83690b\" (UID: \"27e9ff94-f725-4d4d-a987-182faa83690b\") " Sep 17 19:05:08.401695 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.401664 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e9ff94-f725-4d4d-a987-182faa83690b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27e9ff94-f725-4d4d-a987-182faa83690b" (UID: "27e9ff94-f725-4d4d-a987-182faa83690b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:05:08.401796 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.401692 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e9ff94-f725-4d4d-a987-182faa83690b-kube-api-access-47dcd" (OuterVolumeSpecName: "kube-api-access-47dcd") pod "27e9ff94-f725-4d4d-a987-182faa83690b" (UID: "27e9ff94-f725-4d4d-a987-182faa83690b"). InnerVolumeSpecName "kube-api-access-47dcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:05:08.501169 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.501136 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47dcd\" (UniqueName: \"kubernetes.io/projected/27e9ff94-f725-4d4d-a987-182faa83690b-kube-api-access-47dcd\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:05:08.501169 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.501165 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27e9ff94-f725-4d4d-a987-182faa83690b-tls-certs\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:05:08.831957 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.831925 2585 generic.go:356] "Generic (PLEG): container finished" podID="27e9ff94-f725-4d4d-a987-182faa83690b" containerID="3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f" exitCode=0 Sep 17 19:05:08.832156 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.831978 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" Sep 17 19:05:08.832156 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.832002 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" event={"ID":"27e9ff94-f725-4d4d-a987-182faa83690b","Type":"ContainerDied","Data":"3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f"} Sep 17 19:05:08.832156 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.832044 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4" event={"ID":"27e9ff94-f725-4d4d-a987-182faa83690b","Type":"ContainerDied","Data":"d58e638544a1fd0bd90730ede724480f1448743c79c5aaa50012341512c132d4"} Sep 17 19:05:08.832156 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.832067 2585 scope.go:117] "RemoveContainer" containerID="3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f" Sep 17 19:05:08.841112 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.841089 2585 scope.go:117] "RemoveContainer" containerID="3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f" Sep 17 19:05:08.841376 ip-10-0-138-98 kubenswrapper[2585]: E0917 19:05:08.841353 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f\": container with ID starting with 3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f not found: ID does not exist" containerID="3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f" Sep 17 19:05:08.841429 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.841383 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f"} err="failed to get container status \"3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f\": rpc error: code = NotFound desc = could not find container \"3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f\": container with ID starting with 3ab11f499baa174e883b97a4989a4a7edc127bd68129f3e08104743a5e05d55f not found: ID does not exist" Sep 17 19:05:08.858535 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.858508 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4"] Sep 17 19:05:08.861897 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:08.861876 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche2xtr4"] Sep 17 19:05:10.005685 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:10.005650 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" path="/var/lib/kubelet/pods/27e9ff94-f725-4d4d-a987-182faa83690b/volumes" Sep 17 19:05:28.199812 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.199732 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw"] Sep 17 19:05:28.200287 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.200268 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" Sep 17 19:05:28.200363 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.200291 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" Sep 17 19:05:28.200440 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.200426 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e9ff94-f725-4d4d-a987-182faa83690b" containerName="main" Sep 17 19:05:28.204841 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.204818 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.207659 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.207637 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\"" Sep 17 19:05:28.208923 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.208906 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-flpmp\"" Sep 17 19:05:28.209028 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.209000 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"default-dockercfg-jc9wl\"" Sep 17 19:05:28.209145 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.209123 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"openshift-service-ca.crt\"" Sep 17 19:05:28.209212 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.209147 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"kube-root-ca.crt\"" Sep 17 19:05:28.215254 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.215231 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw"] Sep 17 19:05:28.285412 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.285376 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.285568 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.285485 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcbqx\" (UniqueName: \"kubernetes.io/projected/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-kube-api-access-lcbqx\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.386133 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.386102 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.386324 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.386179 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqx\" (UniqueName: \"kubernetes.io/projected/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-kube-api-access-lcbqx\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.388820 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.388788 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.396115 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.396092 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcbqx\" (UniqueName: \"kubernetes.io/projected/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-kube-api-access-lcbqx\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.516032 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.515946 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.801535 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.793715 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw"] Sep 17 19:05:28.802395 ip-10-0-138-98 kubenswrapper[2585]: W0917 19:05:28.802368 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6a2947_0ee7_4a6c_89b9_a42611f1b023.slice/crio-290e1afc65491292826f3c0465e71d5bb6a9f354a3ac7f12c406a4dce5c90bd4 WatchSource:0}: Error finding container 290e1afc65491292826f3c0465e71d5bb6a9f354a3ac7f12c406a4dce5c90bd4: Status 404 returned error can't find the container with id 290e1afc65491292826f3c0465e71d5bb6a9f354a3ac7f12c406a4dce5c90bd4 Sep 17 19:05:28.928259 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.928220 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" event={"ID":"cb6a2947-0ee7-4a6c-89b9-a42611f1b023","Type":"ContainerStarted","Data":"22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf"} Sep 17 19:05:28.928470 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.928324 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" event={"ID":"cb6a2947-0ee7-4a6c-89b9-a42611f1b023","Type":"ContainerStarted","Data":"290e1afc65491292826f3c0465e71d5bb6a9f354a3ac7f12c406a4dce5c90bd4"} Sep 17 19:05:28.928470 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.928354 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:05:28.949110 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:28.949045 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" podStartSLOduration=0.949025266 podStartE2EDuration="949.025266ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:05:28.947802262 +0000 UTC m=+2154.885191130" watchObservedRunningTime="2026-09-17 19:05:28.949025266 +0000 UTC m=+2154.886414130" Sep 17 19:05:59.934147 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:05:59.934115 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:07:32.797871 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:07:32.797834 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw"] Sep 17 19:07:39.934726 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:07:39.934685 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:07:47.817805 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:07:47.817739 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" containerID="cri-o://22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf" gracePeriod=45 Sep 17 19:07:49.934524 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:07:49.934486 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:07:59.934093 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:07:59.934057 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:07:59.934464 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:07:59.934182 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:08:09.934380 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:09.934339 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:08:18.065607 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.065580 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:08:18.147230 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.147137 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-tls-certs\") pod \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " Sep 17 19:08:18.147230 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.147210 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcbqx\" (UniqueName: \"kubernetes.io/projected/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-kube-api-access-lcbqx\") pod \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\" (UID: \"cb6a2947-0ee7-4a6c-89b9-a42611f1b023\") " Sep 17 19:08:18.149374 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.149348 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-kube-api-access-lcbqx" (OuterVolumeSpecName: "kube-api-access-lcbqx") pod "cb6a2947-0ee7-4a6c-89b9-a42611f1b023" (UID: "cb6a2947-0ee7-4a6c-89b9-a42611f1b023"). InnerVolumeSpecName "kube-api-access-lcbqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:08:18.149500 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.149367 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb6a2947-0ee7-4a6c-89b9-a42611f1b023" (UID: "cb6a2947-0ee7-4a6c-89b9-a42611f1b023"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:18.248453 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.248409 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcbqx\" (UniqueName: \"kubernetes.io/projected/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-kube-api-access-lcbqx\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:08:18.248453 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.248444 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6a2947-0ee7-4a6c-89b9-a42611f1b023-tls-certs\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:08:18.725167 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.725065 2585 generic.go:356] "Generic (PLEG): container finished" podID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerID="22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf" exitCode=0 Sep 17 19:08:18.725167 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.725132 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" Sep 17 19:08:18.725401 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.725156 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" event={"ID":"cb6a2947-0ee7-4a6c-89b9-a42611f1b023","Type":"ContainerDied","Data":"22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf"} Sep 17 19:08:18.725401 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.725241 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw" event={"ID":"cb6a2947-0ee7-4a6c-89b9-a42611f1b023","Type":"ContainerDied","Data":"290e1afc65491292826f3c0465e71d5bb6a9f354a3ac7f12c406a4dce5c90bd4"} Sep 17 19:08:18.725401 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.725264 2585 scope.go:117] "RemoveContainer" containerID="22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf" Sep 17 19:08:18.734333 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.734315 2585 scope.go:117] "RemoveContainer" containerID="22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf" Sep 17 19:08:18.734621 ip-10-0-138-98 kubenswrapper[2585]: E0917 19:08:18.734603 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf\": container with ID starting with 22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf not found: ID does not exist" containerID="22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf" Sep 17 19:08:18.734672 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.734629 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf"} err="failed to get container status \"22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf\": rpc error: code = NotFound desc = could not find container \"22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf\": container with ID starting with 22a4c6e8476437d3e777742130eaa0014c140cfc29aa30ead3aaca75d65426cf not found: ID does not exist" Sep 17 19:08:18.752160 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.752132 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw"] Sep 17 19:08:18.762755 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:18.762731 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schevsttw"] Sep 17 19:08:20.005675 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:08:20.005640 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" path="/var/lib/kubelet/pods/cb6a2947-0ee7-4a6c-89b9-a42611f1b023/volumes" Sep 17 19:09:36.160976 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:09:36.160949 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:09:36.168094 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:09:36.168072 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:13:06.662697 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.662613 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv"] Sep 17 19:13:06.663108 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.662991 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" Sep 17 19:13:06.663108 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.663004 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" Sep 17 19:13:06.663108 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.663081 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6a2947-0ee7-4a6c-89b9-a42611f1b023" containerName="main" Sep 17 19:13:06.666024 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.666006 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:06.670144 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.670117 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-cqxf2\"" Sep 17 19:13:06.670270 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.670179 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\"" Sep 17 19:13:06.670270 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.670233 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\"" Sep 17 19:13:06.670382 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.670117 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-bq6zz\"" Sep 17 19:13:06.670382 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.670117 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\"" Sep 17 19:13:06.677862 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.677836 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv"] Sep 17 19:13:06.784206 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.784161 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d328ffb-6778-4841-b618-79e2089aed1e-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:06.784392 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.784279 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbbb\" (UniqueName: \"kubernetes.io/projected/2d328ffb-6778-4841-b618-79e2089aed1e-kube-api-access-zzbbb\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:06.884834 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.884794 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbbb\" (UniqueName: \"kubernetes.io/projected/2d328ffb-6778-4841-b618-79e2089aed1e-kube-api-access-zzbbb\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:06.885044 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.884906 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d328ffb-6778-4841-b618-79e2089aed1e-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:06.887601 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.887573 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d328ffb-6778-4841-b618-79e2089aed1e-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:06.893350 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.893328 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbbb\" (UniqueName: \"kubernetes.io/projected/2d328ffb-6778-4841-b618-79e2089aed1e-kube-api-access-zzbbb\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:06.980143 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:06.980053 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:07.254464 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:07.254423 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv"] Sep 17 19:13:07.256746 ip-10-0-138-98 kubenswrapper[2585]: W0917 19:13:07.256719 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d328ffb_6778_4841_b618_79e2089aed1e.slice/crio-a367bbd4f30e0ab92b216fcc8433e69f2548657b47736117b6c54f1c2793ee8d WatchSource:0}: Error finding container a367bbd4f30e0ab92b216fcc8433e69f2548657b47736117b6c54f1c2793ee8d: Status 404 returned error can't find the container with id a367bbd4f30e0ab92b216fcc8433e69f2548657b47736117b6c54f1c2793ee8d Sep 17 19:13:08.059186 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:08.059143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" event={"ID":"2d328ffb-6778-4841-b618-79e2089aed1e","Type":"ContainerStarted","Data":"719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d"} Sep 17 19:13:08.059585 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:08.059199 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" event={"ID":"2d328ffb-6778-4841-b618-79e2089aed1e","Type":"ContainerStarted","Data":"a367bbd4f30e0ab92b216fcc8433e69f2548657b47736117b6c54f1c2793ee8d"} Sep 17 19:13:08.059585 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:08.059242 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:13:08.078939 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:08.078885 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" podStartSLOduration=2.0788711109999998 podStartE2EDuration="2.078871111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:13:08.077195919 +0000 UTC m=+2614.014584788" watchObservedRunningTime="2026-09-17 19:13:08.078871111 +0000 UTC m=+2614.016259977" Sep 17 19:13:39.065800 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:13:39.065769 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:14:36.190816 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:14:36.190788 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:14:36.198652 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:14:36.198630 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:15:18.438750 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:18.438717 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv"] Sep 17 19:15:19.065626 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:19.065587 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:15:29.064863 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:29.064826 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:15:33.458452 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:33.458383 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" containerID="cri-o://719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d" gracePeriod=45 Sep 17 19:15:39.065631 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:39.065588 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:15:39.066080 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:39.065717 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:15:49.064940 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:49.064862 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:15:59.065265 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:15:59.065227 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:16:03.697877 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.697851 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:16:03.762081 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.762003 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d328ffb-6778-4841-b618-79e2089aed1e-tls-certs\") pod \"2d328ffb-6778-4841-b618-79e2089aed1e\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " Sep 17 19:16:03.762081 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.762079 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzbbb\" (UniqueName: \"kubernetes.io/projected/2d328ffb-6778-4841-b618-79e2089aed1e-kube-api-access-zzbbb\") pod \"2d328ffb-6778-4841-b618-79e2089aed1e\" (UID: \"2d328ffb-6778-4841-b618-79e2089aed1e\") " Sep 17 19:16:03.764003 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.763968 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d328ffb-6778-4841-b618-79e2089aed1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2d328ffb-6778-4841-b618-79e2089aed1e" (UID: "2d328ffb-6778-4841-b618-79e2089aed1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:16:03.764003 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.763975 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d328ffb-6778-4841-b618-79e2089aed1e-kube-api-access-zzbbb" (OuterVolumeSpecName: "kube-api-access-zzbbb") pod "2d328ffb-6778-4841-b618-79e2089aed1e" (UID: "2d328ffb-6778-4841-b618-79e2089aed1e"). InnerVolumeSpecName "kube-api-access-zzbbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:16:03.863089 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.863051 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d328ffb-6778-4841-b618-79e2089aed1e-tls-certs\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:16:03.863089 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.863082 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzbbb\" (UniqueName: \"kubernetes.io/projected/2d328ffb-6778-4841-b618-79e2089aed1e-kube-api-access-zzbbb\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:16:03.877156 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.877120 2585 generic.go:356] "Generic (PLEG): container finished" podID="2d328ffb-6778-4841-b618-79e2089aed1e" containerID="719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d" exitCode=0 Sep 17 19:16:03.877318 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.877171 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" Sep 17 19:16:03.877318 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.877210 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" event={"ID":"2d328ffb-6778-4841-b618-79e2089aed1e","Type":"ContainerDied","Data":"719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d"} Sep 17 19:16:03.877318 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.877283 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv" event={"ID":"2d328ffb-6778-4841-b618-79e2089aed1e","Type":"ContainerDied","Data":"a367bbd4f30e0ab92b216fcc8433e69f2548657b47736117b6c54f1c2793ee8d"} Sep 17 19:16:03.877318 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.877313 2585 scope.go:117] "RemoveContainer" containerID="719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d" Sep 17 19:16:03.886113 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.886095 2585 scope.go:117] "RemoveContainer" containerID="719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d" Sep 17 19:16:03.886393 ip-10-0-138-98 kubenswrapper[2585]: E0917 19:16:03.886376 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d\": container with ID starting with 719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d not found: ID does not exist" containerID="719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d" Sep 17 19:16:03.886440 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.886402 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d"} err="failed to get container status \"719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d\": rpc error: code = NotFound desc = could not find container \"719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d\": container with ID starting with 719900397e388e63d2e18af07f4f5f17901d99fca6fe636c855a167cf688731d not found: ID does not exist" Sep 17 19:16:03.897978 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.897954 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv"] Sep 17 19:16:03.903050 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:03.903024 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-hhcgv"] Sep 17 19:16:04.005029 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:16:04.004976 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" path="/var/lib/kubelet/pods/2d328ffb-6778-4841-b618-79e2089aed1e/volumes" Sep 17 19:19:36.219618 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:19:36.219589 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:19:36.229941 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:19:36.229919 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:24:36.254514 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:24:36.254484 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:24:36.265446 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:24:36.265424 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:29:36.284005 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:29:36.283959 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:29:36.295669 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:29:36.295648 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:30:23.837384 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.837347 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk"] Sep 17 19:30:23.838044 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.837718 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" Sep 17 19:30:23.838044 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.837730 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" Sep 17 19:30:23.838044 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.837803 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d328ffb-6778-4841-b618-79e2089aed1e" containerName="main" Sep 17 19:30:23.840798 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.840778 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:23.845496 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.845470 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\"" Sep 17 19:30:23.845496 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.845487 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"kube-root-ca.crt\"" Sep 17 19:30:23.845673 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.845554 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"openshift-service-ca.crt\"" Sep 17 19:30:23.845673 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.845606 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"default-dockercfg-4s2v6\"" Sep 17 19:30:23.845766 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.845705 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa-dockercfg-rg7l9\"" Sep 17 19:30:23.852042 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.852018 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk"] Sep 17 19:30:23.949442 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.949398 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsp7d\" (UniqueName: \"kubernetes.io/projected/90193235-a1a3-475f-85f2-97e48b9d2bef-kube-api-access-jsp7d\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:23.949442 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:23.949449 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90193235-a1a3-475f-85f2-97e48b9d2bef-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:24.050521 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.050488 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsp7d\" (UniqueName: \"kubernetes.io/projected/90193235-a1a3-475f-85f2-97e48b9d2bef-kube-api-access-jsp7d\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:24.050700 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.050540 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90193235-a1a3-475f-85f2-97e48b9d2bef-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:24.053272 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.053237 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90193235-a1a3-475f-85f2-97e48b9d2bef-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:24.058787 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.058760 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsp7d\" (UniqueName: \"kubernetes.io/projected/90193235-a1a3-475f-85f2-97e48b9d2bef-kube-api-access-jsp7d\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:24.152251 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.152161 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:24.430562 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.430537 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk"] Sep 17 19:30:24.433007 ip-10-0-138-98 kubenswrapper[2585]: W0917 19:30:24.432964 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90193235_a1a3_475f_85f2_97e48b9d2bef.slice/crio-396e505e15cf76f61506af92c82e21a22777704be2ecaa226ddd47f5dc2f86f4 WatchSource:0}: Error finding container 396e505e15cf76f61506af92c82e21a22777704be2ecaa226ddd47f5dc2f86f4: Status 404 returned error can't find the container with id 396e505e15cf76f61506af92c82e21a22777704be2ecaa226ddd47f5dc2f86f4 Sep 17 19:30:24.824418 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.824379 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" event={"ID":"90193235-a1a3-475f-85f2-97e48b9d2bef","Type":"ContainerStarted","Data":"7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f"} Sep 17 19:30:24.824587 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.824441 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" event={"ID":"90193235-a1a3-475f-85f2-97e48b9d2bef","Type":"ContainerStarted","Data":"396e505e15cf76f61506af92c82e21a22777704be2ecaa226ddd47f5dc2f86f4"} Sep 17 19:30:24.824587 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.824463 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:24.847310 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:24.847262 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" podStartSLOduration=1.847246521 podStartE2EDuration="1.847246521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:30:24.846214744 +0000 UTC m=+3650.783603610" watchObservedRunningTime="2026-09-17 19:30:24.847246521 +0000 UTC m=+3650.784635388" Sep 17 19:30:55.831684 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:55.831604 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:30:57.412548 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:30:57.412510 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk"] Sep 17 19:31:05.831698 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:05.831662 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:31:12.432296 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:12.432255 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" containerID="cri-o://7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f" gracePeriod=45 Sep 17 19:31:15.831074 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:15.831028 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:31:25.831021 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:25.830967 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:31:25.831395 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:25.831084 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:31:35.831122 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:35.831077 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:31:42.681461 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:42.681433 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:31:42.862954 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:42.862926 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsp7d\" (UniqueName: \"kubernetes.io/projected/90193235-a1a3-475f-85f2-97e48b9d2bef-kube-api-access-jsp7d\") pod \"90193235-a1a3-475f-85f2-97e48b9d2bef\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " Sep 17 19:31:42.863136 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:42.863005 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90193235-a1a3-475f-85f2-97e48b9d2bef-tls-certs\") pod \"90193235-a1a3-475f-85f2-97e48b9d2bef\" (UID: \"90193235-a1a3-475f-85f2-97e48b9d2bef\") " Sep 17 19:31:42.865226 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:42.865200 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90193235-a1a3-475f-85f2-97e48b9d2bef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90193235-a1a3-475f-85f2-97e48b9d2bef" (UID: "90193235-a1a3-475f-85f2-97e48b9d2bef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:31:42.865226 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:42.865216 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90193235-a1a3-475f-85f2-97e48b9d2bef-kube-api-access-jsp7d" (OuterVolumeSpecName: "kube-api-access-jsp7d") pod "90193235-a1a3-475f-85f2-97e48b9d2bef" (UID: "90193235-a1a3-475f-85f2-97e48b9d2bef"). InnerVolumeSpecName "kube-api-access-jsp7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:31:42.963683 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:42.963650 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsp7d\" (UniqueName: \"kubernetes.io/projected/90193235-a1a3-475f-85f2-97e48b9d2bef-kube-api-access-jsp7d\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:31:42.963683 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:42.963679 2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90193235-a1a3-475f-85f2-97e48b9d2bef-tls-certs\") on node \"ip-10-0-138-98.ec2.internal\" DevicePath \"\"" Sep 17 19:31:43.187625 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.187548 2585 generic.go:356] "Generic (PLEG): container finished" podID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerID="7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f" exitCode=0 Sep 17 19:31:43.187625 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.187611 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" Sep 17 19:31:43.187805 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.187635 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" event={"ID":"90193235-a1a3-475f-85f2-97e48b9d2bef","Type":"ContainerDied","Data":"7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f"} Sep 17 19:31:43.187805 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.187697 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk" event={"ID":"90193235-a1a3-475f-85f2-97e48b9d2bef","Type":"ContainerDied","Data":"396e505e15cf76f61506af92c82e21a22777704be2ecaa226ddd47f5dc2f86f4"} Sep 17 19:31:43.187805 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.187725 2585 scope.go:117] "RemoveContainer" containerID="7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f" Sep 17 19:31:43.196898 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.196875 2585 scope.go:117] "RemoveContainer" containerID="7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f" Sep 17 19:31:43.197203 ip-10-0-138-98 kubenswrapper[2585]: E0917 19:31:43.197167 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f\": container with ID starting with 7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f not found: ID does not exist" containerID="7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f" Sep 17 19:31:43.197308 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.197210 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f"} err="failed to get container status \"7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f\": rpc error: code = NotFound desc = could not find container \"7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f\": container with ID starting with 7f674fdb40d3e34a324fce27b9b5bfa0b9ab92d6f7885d0a0877957fc08cdb2f not found: ID does not exist" Sep 17 19:31:43.209196 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.209170 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk"] Sep 17 19:31:43.213322 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:43.213300 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schecplxk"] Sep 17 19:31:44.005644 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:31:44.005607 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" path="/var/lib/kubelet/pods/90193235-a1a3-475f-85f2-97e48b9d2bef/volumes" Sep 17 19:34:36.315049 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:34:36.315022 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:34:36.325961 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:34:36.325939 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:35:37.933738 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:37.933520 2585 ???:1] "http: TLS handshake error from 10.0.136.132:58086: EOF" Sep 17 19:35:38.060326 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:38.060293 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lnff_ad5f9be6-2360-44d8-bf07-b84f42726540/discovery/0.log" Sep 17 19:35:39.112272 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:39.112236 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lnff_ad5f9be6-2360-44d8-bf07-b84f42726540/discovery/0.log" Sep 17 19:35:40.052551 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:40.052520 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-wlhqd_d637e772-47c1-4811-be69-0c8ba2d5403c/manager/0.log" Sep 17 19:35:40.075002 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:40.074954 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-gq2bt_18510283-c528-4265-9f7b-6de8494837db/kuadrant-console-plugin/0.log" Sep 17 19:35:40.207345 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:40.207308 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-6d4cb79c-m25mp_46a92f5a-6460-40b5-8f44-0c2e338d0e13/manager/0.log" Sep 17 19:35:48.957326 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:48.957296 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8v8g7_ae3ae15d-0775-4489-a8a9-4723f82c7376/global-pull-secret-syncer/0.log" Sep 17 19:35:49.085661 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:49.085624 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l2h2v_525e9d9c-1072-4eb5-bc02-d36db0353299/konnectivity-agent/0.log" Sep 17 19:35:49.228383 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:49.228307 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-98.ec2.internal_d08f152a589114ccae524fe85db2c916/haproxy/0.log" Sep 17 19:35:53.788972 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:53.788941 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-wlhqd_d637e772-47c1-4811-be69-0c8ba2d5403c/manager/0.log" Sep 17 19:35:53.831862 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:53.831840 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-gq2bt_18510283-c528-4265-9f7b-6de8494837db/kuadrant-console-plugin/0.log" Sep 17 19:35:53.996232 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:53.996195 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-6d4cb79c-m25mp_46a92f5a-6460-40b5-8f44-0c2e338d0e13/manager/0.log" Sep 17 19:35:55.428503 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.428463 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fd6d2c6-efee-425c-8d11-2d62a3aacd0b/alertmanager/0.log" Sep 17 19:35:55.469259 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.469230 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fd6d2c6-efee-425c-8d11-2d62a3aacd0b/config-reloader/0.log" Sep 17 19:35:55.494257 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.494236 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fd6d2c6-efee-425c-8d11-2d62a3aacd0b/kube-rbac-proxy-web/0.log" Sep 17 19:35:55.518286 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.518255 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fd6d2c6-efee-425c-8d11-2d62a3aacd0b/kube-rbac-proxy/0.log" Sep 17 19:35:55.541509 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.541486 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fd6d2c6-efee-425c-8d11-2d62a3aacd0b/kube-rbac-proxy-metric/0.log" Sep 17 19:35:55.569643 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.569622 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fd6d2c6-efee-425c-8d11-2d62a3aacd0b/prom-label-proxy/0.log" Sep 17 19:35:55.592818 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.592797 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fd6d2c6-efee-425c-8d11-2d62a3aacd0b/init-config-reloader/0.log" Sep 17 19:35:55.675319 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.675290 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-5v6xf_33820ecb-420a-4aab-891f-1817764ea623/kube-state-metrics/0.log" Sep 17 19:35:55.694218 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.694194 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-5v6xf_33820ecb-420a-4aab-891f-1817764ea623/kube-rbac-proxy-main/0.log" Sep 17 19:35:55.717132 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.717099 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-5v6xf_33820ecb-420a-4aab-891f-1817764ea623/kube-rbac-proxy-self/0.log" Sep 17 19:35:55.781213 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.781191 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-ml2jv_97f3aa4f-9f50-4e64-a7cb-0db0dc50f310/monitoring-plugin/0.log" Sep 17 19:35:55.903838 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.903815 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m79fk_ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078/node-exporter/0.log" Sep 17 19:35:55.930091 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.930069 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m79fk_ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078/kube-rbac-proxy/0.log" Sep 17 19:35:55.957858 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:55.957840 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m79fk_ffaaf873-8fea-47bf-a6eb-5c7f7bfb2078/init-textfile/0.log" Sep 17 19:35:56.096919 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.096847 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hgr9t_8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42/kube-rbac-proxy-main/0.log" Sep 17 19:35:56.119200 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.119172 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hgr9t_8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42/kube-rbac-proxy-self/0.log" Sep 17 19:35:56.140187 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.140164 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hgr9t_8c6f3e59-5754-41b7-9fb8-ec66fdbaeb42/openshift-state-metrics/0.log" Sep 17 19:35:56.204518 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.204482 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ec5a73d-6655-4d58-9f04-2620585be4e0/prometheus/0.log" Sep 17 19:35:56.233270 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.233242 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ec5a73d-6655-4d58-9f04-2620585be4e0/config-reloader/0.log" Sep 17 19:35:56.265317 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.265292 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ec5a73d-6655-4d58-9f04-2620585be4e0/thanos-sidecar/0.log" Sep 17 19:35:56.297829 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.297809 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ec5a73d-6655-4d58-9f04-2620585be4e0/kube-rbac-proxy-web/0.log" Sep 17 19:35:56.325413 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.325389 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ec5a73d-6655-4d58-9f04-2620585be4e0/kube-rbac-proxy/0.log" Sep 17 19:35:56.368914 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.368854 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ec5a73d-6655-4d58-9f04-2620585be4e0/kube-rbac-proxy-thanos/0.log" Sep 17 19:35:56.402099 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.402074 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ec5a73d-6655-4d58-9f04-2620585be4e0/init-config-reloader/0.log" Sep 17 19:35:56.435316 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.435290 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-rhrxh_52aef56a-4b06-433e-9ab6-50f49ebfecc8/prometheus-operator/0.log" Sep 17 19:35:56.480536 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.480518 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-rhrxh_52aef56a-4b06-433e-9ab6-50f49ebfecc8/kube-rbac-proxy/0.log" Sep 17 19:35:56.526485 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.526458 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-fmzg8_d8d0f58e-9937-4a19-aee0-3c038581ebfb/prometheus-operator-admission-webhook/0.log" Sep 17 19:35:56.671139 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.671070 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcbd54f68-4nptl_712083db-a68f-46b7-acb2-6d3a61b91b05/thanos-query/0.log" Sep 17 19:35:56.697453 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.697428 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcbd54f68-4nptl_712083db-a68f-46b7-acb2-6d3a61b91b05/kube-rbac-proxy-web/0.log" Sep 17 19:35:56.724626 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.724605 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcbd54f68-4nptl_712083db-a68f-46b7-acb2-6d3a61b91b05/kube-rbac-proxy/0.log" Sep 17 19:35:56.751889 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.751868 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcbd54f68-4nptl_712083db-a68f-46b7-acb2-6d3a61b91b05/prom-label-proxy/0.log" Sep 17 19:35:56.782486 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.782465 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcbd54f68-4nptl_712083db-a68f-46b7-acb2-6d3a61b91b05/kube-rbac-proxy-rules/0.log" Sep 17 19:35:56.805237 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:56.805215 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcbd54f68-4nptl_712083db-a68f-46b7-acb2-6d3a61b91b05/kube-rbac-proxy-metrics/0.log" Sep 17 19:35:58.954653 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:58.954622 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cb566b88b-hlpqs_7d657f20-723e-4344-85b5-d39ecc2976ad/console/0.log" Sep 17 19:35:59.365787 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.365754 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc"] Sep 17 19:35:59.366233 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.366215 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" Sep 17 19:35:59.366332 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.366235 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" Sep 17 19:35:59.366385 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.366341 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="90193235-a1a3-475f-85f2-97e48b9d2bef" containerName="main" Sep 17 19:35:59.369745 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.369722 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.373559 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.373539 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4lb2x\"/\"default-dockercfg-zzdfx\"" Sep 17 19:35:59.373768 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.373753 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4lb2x\"/\"kube-root-ca.crt\"" Sep 17 19:35:59.384487 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.384466 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4lb2x\"/\"openshift-service-ca.crt\"" Sep 17 19:35:59.389585 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.389559 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc"] Sep 17 19:35:59.433017 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.432966 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-sys\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.433017 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.433017 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-podres\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.433244 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.433070 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-proc\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.433244 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.433161 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-lib-modules\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.433244 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.433190 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8q2v\" (UniqueName: \"kubernetes.io/projected/621b5797-dc78-494a-935f-0f972509daf6-kube-api-access-q8q2v\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533715 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533677 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-lib-modules\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533715 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533717 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8q2v\" (UniqueName: \"kubernetes.io/projected/621b5797-dc78-494a-935f-0f972509daf6-kube-api-access-q8q2v\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533929 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533767 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-sys\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533929 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533788 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-podres\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533929 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533804 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-proc\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533929 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533838 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-lib-modules\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533929 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-sys\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.533929 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533885 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-proc\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.534150 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.533933 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/621b5797-dc78-494a-935f-0f972509daf6-podres\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.543083 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.543060 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8q2v\" (UniqueName: \"kubernetes.io/projected/621b5797-dc78-494a-935f-0f972509daf6-kube-api-access-q8q2v\") pod \"perf-node-gather-daemonset-j8zqc\" (UID: \"621b5797-dc78-494a-935f-0f972509daf6\") " pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.680188 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.680098 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:35:59.950216 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:35:59.950184 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc"] Sep 17 19:35:59.952606 ip-10-0-138-98 kubenswrapper[2585]: W0917 19:35:59.952582 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod621b5797_dc78_494a_935f_0f972509daf6.slice/crio-bcc1440eea88bc26bb788e890a0ba2a804a09da270c00f5e3d3dd85caf0c1c0b WatchSource:0}: Error finding container bcc1440eea88bc26bb788e890a0ba2a804a09da270c00f5e3d3dd85caf0c1c0b: Status 404 returned error can't find the container with id bcc1440eea88bc26bb788e890a0ba2a804a09da270c00f5e3d3dd85caf0c1c0b Sep 17 19:36:00.368493 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:00.368451 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" event={"ID":"621b5797-dc78-494a-935f-0f972509daf6","Type":"ContainerStarted","Data":"1b4955e7fec001eb868046d297c0ecd62b7eb56ac5305b710112e25318a64681"} Sep 17 19:36:00.368974 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:00.368515 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" event={"ID":"621b5797-dc78-494a-935f-0f972509daf6","Type":"ContainerStarted","Data":"bcc1440eea88bc26bb788e890a0ba2a804a09da270c00f5e3d3dd85caf0c1c0b"} Sep 17 19:36:00.368974 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:00.368543 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:36:00.387204 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:00.387153 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" podStartSLOduration=1.387137945 podStartE2EDuration="1.387137945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:36:00.386190539 +0000 UTC m=+3986.323579406" watchObservedRunningTime="2026-09-17 19:36:00.387137945 +0000 UTC m=+3986.324526811" Sep 17 19:36:00.686596 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:00.686515 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-69mlq_4cb04374-96b9-4622-af35-7456553fe8e4/dns/0.log" Sep 17 19:36:00.709344 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:00.709319 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-69mlq_4cb04374-96b9-4622-af35-7456553fe8e4/kube-rbac-proxy/0.log" Sep 17 19:36:00.850713 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:00.850687 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gxqb6_03b9acbe-9f26-41a7-83b1-25c1f587cbd0/dns-node-resolver/0.log" Sep 17 19:36:01.392299 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:01.392261 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b7798b895-6pcq9_f52cc90c-e13d-4999-99da-552a0c3902bc/registry/0.log" Sep 17 19:36:01.465993 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:01.465951 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8lp5_d57b8158-cb69-4f87-a3f1-5d4cfeb2fb45/node-ca/0.log" Sep 17 19:36:02.504957 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:02.504921 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lnff_ad5f9be6-2360-44d8-bf07-b84f42726540/discovery/0.log" Sep 17 19:36:03.081131 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:03.081086 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4w846_1f2f41dc-f6ba-4c88-9918-63f61c14248d/serve-healthcheck-canary/0.log" Sep 17 19:36:03.727224 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:03.727195 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zrxvn_edf6a230-cfb9-4503-9c2d-dd0884fb44ec/kube-rbac-proxy/0.log" Sep 17 19:36:03.749813 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:03.749790 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zrxvn_edf6a230-cfb9-4503-9c2d-dd0884fb44ec/exporter/0.log" Sep 17 19:36:03.773710 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:03.773686 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zrxvn_edf6a230-cfb9-4503-9c2d-dd0884fb44ec/extractor/0.log" Sep 17 19:36:06.383955 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:06.383923 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4lb2x/perf-node-gather-daemonset-j8zqc" Sep 17 19:36:06.768169 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:06.768091 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7594644fcd-ws5w6_99845284-5f60-4634-a601-c1a25b32ea74/manager/0.log" Sep 17 19:36:08.945569 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:08.945534 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lnff_ad5f9be6-2360-44d8-bf07-b84f42726540/discovery/0.log" Sep 17 19:36:10.344280 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:10.344251 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lnff_ad5f9be6-2360-44d8-bf07-b84f42726540/discovery/0.log" Sep 17 19:36:15.948462 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:15.948433 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvjbw_7e725bf4-527b-4c77-b6c9-7e9c9d6a169e/kube-multus-additional-cni-plugins/0.log" Sep 17 19:36:15.971294 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:15.971261 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvjbw_7e725bf4-527b-4c77-b6c9-7e9c9d6a169e/egress-router-binary-copy/0.log" Sep 17 19:36:15.990541 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:15.990515 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvjbw_7e725bf4-527b-4c77-b6c9-7e9c9d6a169e/cni-plugins/0.log" Sep 17 19:36:16.010941 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:16.010916 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvjbw_7e725bf4-527b-4c77-b6c9-7e9c9d6a169e/bond-cni-plugin/0.log" Sep 17 19:36:16.031831 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:16.031804 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvjbw_7e725bf4-527b-4c77-b6c9-7e9c9d6a169e/routeoverride-cni/0.log" Sep 17 19:36:16.056365 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:16.056313 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvjbw_7e725bf4-527b-4c77-b6c9-7e9c9d6a169e/whereabouts-cni-bincopy/0.log" Sep 17 19:36:16.076639 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:16.076604 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xvjbw_7e725bf4-527b-4c77-b6c9-7e9c9d6a169e/whereabouts-cni/0.log" Sep 17 19:36:16.238522 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:16.238442 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qpjtf_d1c9edf0-f044-46d6-a1aa-e0a13f309c88/kube-multus/0.log" Sep 17 19:36:16.333713 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:16.333683 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fqgnw_c57d2d2f-f606-45f4-84bf-0dee13e4adeb/network-metrics-daemon/0.log" Sep 17 19:36:16.354613 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:16.354585 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fqgnw_c57d2d2f-f606-45f4-84bf-0dee13e4adeb/kube-rbac-proxy/0.log" Sep 17 19:36:17.573573 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.573540 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-controller/0.log" Sep 17 19:36:17.593494 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.593466 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/0.log" Sep 17 19:36:17.593681 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.593465 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovn-acl-logging/1.log" Sep 17 19:36:17.612628 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.612603 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/kube-rbac-proxy-node/0.log" Sep 17 19:36:17.634515 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.634481 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 19:36:17.653391 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.653365 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/northd/0.log" Sep 17 19:36:17.671573 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.671548 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/nbdb/0.log" Sep 17 19:36:17.691292 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.691259 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/sbdb/0.log" Sep 17 19:36:17.766295 ip-10-0-138-98 kubenswrapper[2585]: I0917 19:36:17.766262 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dp89z_4667e603-efca-4e0b-b313-47bb8d38085d/ovnkube-controller/0.log"