Sep 19 01:37:18.681202 ip-10-0-139-3 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 19 01:37:18.681213 ip-10-0-139-3 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 19 01:37:18.681220 ip-10-0-139-3 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 19 01:37:18.681360 ip-10-0-139-3 systemd[1]: Failed to start Kubernetes Kubelet. Sep 19 01:37:28.930136 ip-10-0-139-3 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 19 01:37:28.930151 ip-10-0-139-3 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f43198d756164098a3d83da98575131b -- Sep 19 01:39:18.887847 ip-10-0-139-3 systemd[1]: Starting Kubernetes Kubelet... Sep 19 01:39:22.292726 ip-10-0-139-3 kubenswrapper[2587]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:22.292726 ip-10-0-139-3 kubenswrapper[2587]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 19 01:39:22.292726 ip-10-0-139-3 kubenswrapper[2587]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:22.292726 ip-10-0-139-3 kubenswrapper[2587]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 19 01:39:22.292726 ip-10-0-139-3 kubenswrapper[2587]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:22.293417 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.293144 2587 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 19 01:39:22.297784 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297769 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:22.297784 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297784 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297788 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297791 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297795 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297797 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297800 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297803 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297811 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297814 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297816 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297819 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297821 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297824 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297827 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297829 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297832 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297834 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297836 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297839 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297841 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:22.297849 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297844 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297847 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297849 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297852 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297855 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297858 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297861 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297863 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297866 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297869 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297873 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297877 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297880 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297883 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297886 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297889 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297893 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297896 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297898 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297900 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:22.298375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297903 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297905 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297908 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297910 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297913 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297915 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297918 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297921 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297923 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297926 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297928 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297931 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297933 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297936 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297938 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297941 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297943 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297946 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297948 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:22.298881 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297951 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297953 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297955 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297958 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297962 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297965 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297968 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297970 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297972 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297975 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297977 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297979 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297982 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297984 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297988 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297992 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297995 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.297998 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298001 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:22.299341 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298005 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298008 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298010 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298013 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298016 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298018 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298021 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298023 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298026 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298028 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298031 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298033 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298036 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298038 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298041 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298044 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298046 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298049 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298051 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298054 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:22.299809 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298806 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298813 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298816 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298819 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298822 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298824 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298827 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298830 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298833 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298836 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298839 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298841 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298844 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298846 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298849 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298851 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298853 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298856 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298858 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:22.300285 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298861 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298864 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298867 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298870 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298872 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298875 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298877 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298880 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298882 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298885 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298888 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298890 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298893 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298895 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298900 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298903 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298907 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298909 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298912 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298914 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:22.300821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298916 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298919 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298922 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298925 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298927 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298930 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298933 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298936 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298938 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298941 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298943 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298947 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298951 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298954 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298957 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298960 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298962 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298965 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298967 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:22.301314 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298970 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298972 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298975 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298977 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298980 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298982 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298985 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298987 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298990 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298993 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298995 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.298998 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299000 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299003 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299005 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299008 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299011 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299013 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299016 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299020 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:22.301801 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299024 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299026 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299029 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299032 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299035 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299038 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299041 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299044 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299046 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299049 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299051 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299054 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299056 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299059 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299062 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299064 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299067 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299069 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299072 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299074 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:22.302294 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299077 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299502 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299507 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299510 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299514 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299517 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299520 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299523 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299532 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299535 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299538 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299542 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299545 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299548 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299550 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299553 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299555 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299558 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299561 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299579 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:22.302789 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299582 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299584 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299587 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299589 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299592 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299594 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299596 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299599 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299602 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299604 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299607 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299609 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299612 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299617 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299619 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299622 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299624 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299627 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299629 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299632 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:22.303277 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299635 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299644 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299650 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299652 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299655 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299657 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299660 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299662 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299665 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299667 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299669 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299672 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299675 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299678 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299680 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299683 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299685 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299687 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299690 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299692 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:22.303771 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299694 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299697 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299699 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299703 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299707 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299713 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299716 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299719 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299722 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299725 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299727 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299730 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299732 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299735 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299744 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299746 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299749 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299752 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299754 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:22.304246 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299757 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299759 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299762 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299764 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299766 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299769 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299771 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299773 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299776 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299778 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299781 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299783 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299785 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299788 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299790 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299793 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299795 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299798 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299802 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299804 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:22.304721 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.299806 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299877 2587 flags.go:64] FLAG: --address="0.0.0.0" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299910 2587 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299920 2587 flags.go:64] FLAG: --anonymous-auth="true" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299924 2587 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299928 2587 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299931 2587 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299934 2587 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299944 2587 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299947 2587 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299950 2587 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299954 2587 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299957 2587 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299960 2587 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299963 2587 flags.go:64] FLAG: --cgroup-root="" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299965 2587 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299968 2587 flags.go:64] FLAG: --client-ca-file="" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299971 2587 flags.go:64] FLAG: --cloud-provider="external" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299974 2587 flags.go:64] FLAG: --cluster-dns="[]" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299980 2587 flags.go:64] FLAG: --cluster-domain="" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299983 2587 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299985 2587 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299988 2587 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299991 2587 flags.go:64] FLAG: --container-log-max-files="5" Sep 19 01:39:22.305215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299995 2587 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.299998 2587 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300001 2587 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300004 2587 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300007 2587 flags.go:64] FLAG: --contention-profiling="false" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300010 2587 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300014 2587 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300017 2587 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300020 2587 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300030 2587 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300033 2587 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300036 2587 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300039 2587 flags.go:64] FLAG: --enable-load-reader="false" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300041 2587 flags.go:64] FLAG: --enable-server="true" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300044 2587 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300051 2587 flags.go:64] FLAG: --event-burst="100" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300054 2587 flags.go:64] FLAG: --event-qps="50" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300063 2587 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300066 2587 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300069 2587 flags.go:64] FLAG: --eviction-hard="" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300072 2587 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300075 2587 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300078 2587 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300081 2587 flags.go:64] FLAG: --eviction-soft="" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300084 2587 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 19 01:39:22.305816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300086 2587 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300089 2587 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300092 2587 flags.go:64] FLAG: --experimental-mounter-path="" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300095 2587 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300098 2587 flags.go:64] FLAG: --fail-swap-on="true" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300100 2587 flags.go:64] FLAG: --feature-gates="" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300104 2587 flags.go:64] FLAG: --file-check-frequency="20s" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300107 2587 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300110 2587 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300113 2587 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300116 2587 flags.go:64] FLAG: --healthz-port="10248" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300119 2587 flags.go:64] FLAG: --help="false" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300122 2587 flags.go:64] FLAG: --hostname-override="ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300126 2587 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300129 2587 flags.go:64] FLAG: --http-check-frequency="20s" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300131 2587 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300136 2587 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300139 2587 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300142 2587 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300145 2587 flags.go:64] FLAG: --image-service-endpoint="" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300147 2587 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300150 2587 flags.go:64] FLAG: --kube-api-burst="100" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300154 2587 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300156 2587 flags.go:64] FLAG: --kube-api-qps="50" Sep 19 01:39:22.306458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300159 2587 flags.go:64] FLAG: --kube-reserved="" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300168 2587 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300171 2587 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300174 2587 flags.go:64] FLAG: --kubelet-cgroups="" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300177 2587 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300179 2587 flags.go:64] FLAG: --lock-file="" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300182 2587 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300185 2587 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300187 2587 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300193 2587 flags.go:64] FLAG: --log-json-split-stream="false" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300195 2587 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300198 2587 flags.go:64] FLAG: --log-text-split-stream="false" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300201 2587 flags.go:64] FLAG: --logging-format="text" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300204 2587 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300207 2587 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300209 2587 flags.go:64] FLAG: --manifest-url="" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300212 2587 flags.go:64] FLAG: --manifest-url-header="" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300216 2587 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300219 2587 flags.go:64] FLAG: --max-open-files="1000000" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300222 2587 flags.go:64] FLAG: --max-pods="110" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300225 2587 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300229 2587 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300232 2587 flags.go:64] FLAG: --memory-manager-policy="None" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300235 2587 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300239 2587 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 19 01:39:22.307132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300242 2587 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300245 2587 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300251 2587 flags.go:64] FLAG: --node-status-max-images="50" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300254 2587 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300257 2587 flags.go:64] FLAG: --oom-score-adj="-999" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300260 2587 flags.go:64] FLAG: --pod-cidr="" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300263 2587 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300267 2587 flags.go:64] FLAG: --pod-manifest-path="" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300270 2587 flags.go:64] FLAG: --pod-max-pids="-1" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300279 2587 flags.go:64] FLAG: --pods-per-core="0" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300282 2587 flags.go:64] FLAG: --port="10250" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300285 2587 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300288 2587 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0324b9abbf296c54c" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300291 2587 flags.go:64] FLAG: --qos-reserved="" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300294 2587 flags.go:64] FLAG: --read-only-port="10255" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300297 2587 flags.go:64] FLAG: --register-node="true" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300300 2587 flags.go:64] FLAG: --register-with-taints="" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300304 2587 flags.go:64] FLAG: --registry-burst="10" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300307 2587 flags.go:64] FLAG: --registry-qps="5" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300309 2587 flags.go:64] FLAG: --reserved-cpus="" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300312 2587 flags.go:64] FLAG: --reserved-memory="" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300315 2587 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300318 2587 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300321 2587 flags.go:64] FLAG: --rotate-certificates="false" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300324 2587 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 19 01:39:22.307780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300327 2587 flags.go:64] FLAG: --runonce="false" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300329 2587 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300332 2587 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300336 2587 flags.go:64] FLAG: --seccomp-default="false" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300338 2587 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300341 2587 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300344 2587 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300348 2587 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300351 2587 flags.go:64] FLAG: --storage-driver-password="root" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300354 2587 flags.go:64] FLAG: --storage-driver-secure="false" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300357 2587 flags.go:64] FLAG: --storage-driver-table="stats" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300360 2587 flags.go:64] FLAG: --storage-driver-user="root" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300363 2587 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300366 2587 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300369 2587 flags.go:64] FLAG: --system-cgroups="" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300371 2587 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300376 2587 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300385 2587 flags.go:64] FLAG: --tls-cert-file="" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300388 2587 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300393 2587 flags.go:64] FLAG: --tls-min-version="" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300397 2587 flags.go:64] FLAG: --tls-private-key-file="" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300399 2587 flags.go:64] FLAG: --topology-manager-policy="none" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300402 2587 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300405 2587 flags.go:64] FLAG: --topology-manager-scope="container" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300407 2587 flags.go:64] FLAG: --v="2" Sep 19 01:39:22.308477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300411 2587 flags.go:64] FLAG: --version="false" Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300415 2587 flags.go:64] FLAG: --vmodule="" Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300419 2587 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.300422 2587 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300600 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300604 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300608 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300611 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300613 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300616 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300618 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300622 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300626 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300628 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300631 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300634 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300637 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300639 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300642 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300645 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:22.309414 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300647 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300649 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300652 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300654 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300657 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300667 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300669 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300672 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300674 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300677 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300679 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300687 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300690 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300693 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300696 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300699 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300701 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300704 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300707 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:22.309929 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300709 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300711 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300714 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300716 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300719 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300721 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300724 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300726 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300729 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300731 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300734 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300736 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300739 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300741 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300744 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300746 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300749 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300751 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300753 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300762 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:22.310387 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300771 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300775 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300777 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300780 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300782 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300785 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300787 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300789 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300792 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300795 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300797 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300800 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300802 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300804 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300807 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300809 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300812 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300815 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300819 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300822 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:22.310931 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300825 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300827 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300830 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300833 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300835 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300838 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300840 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300843 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300860 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300863 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300868 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300870 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300882 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300885 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300887 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300890 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300892 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300895 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300897 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300900 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:22.311421 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300902 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300905 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300909 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.300912 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.301487 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.310707 2587 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.310721 2587 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.310740 2587 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.310749 2587 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310813 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310818 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310821 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310824 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310827 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310830 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:22.311923 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310833 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310836 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310839 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310842 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310845 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310847 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310850 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310853 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310855 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310858 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310860 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310863 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310865 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310868 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310870 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310873 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310875 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310878 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310880 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310883 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:22.312291 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310885 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310888 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310892 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310895 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310898 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310900 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310903 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310905 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310908 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310910 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310914 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310918 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310921 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310923 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310926 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310929 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310931 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310935 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310938 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:22.312788 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310941 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310944 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310946 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310949 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310951 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310954 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310956 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310959 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310961 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310964 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310966 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310969 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310972 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310975 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310979 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310982 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310986 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310989 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310992 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:22.313250 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310994 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.310997 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311000 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311002 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311005 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311007 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311010 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311012 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311015 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311018 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311020 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311022 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311025 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311027 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311030 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311034 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311038 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311041 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311043 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311046 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:22.313778 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311048 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311050 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311053 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311055 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311058 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311060 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311063 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311065 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311068 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311070 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311073 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311076 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311078 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311081 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311083 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:22.314264 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.311088 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311220 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311224 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311227 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311230 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311233 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311236 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311239 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311241 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311244 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311246 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311248 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311251 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311254 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311257 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311259 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311262 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311264 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311267 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311270 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:22.314647 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311272 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311274 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311277 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311279 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311282 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311284 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311287 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311290 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311292 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311295 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311297 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311300 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311302 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311305 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311308 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311310 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311313 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311315 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311317 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311320 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:22.315121 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311322 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311325 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311327 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311330 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311332 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311335 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311338 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311340 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311343 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311345 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311348 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311350 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311353 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311355 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311358 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311360 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311363 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311365 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311368 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311370 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:22.315696 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311373 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311375 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311378 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311381 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311385 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311388 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311391 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311394 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311396 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311399 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311402 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311405 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311407 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311410 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311413 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311415 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311417 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311422 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311425 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:22.316185 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311428 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311431 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311434 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311436 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311439 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311442 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311444 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311447 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311450 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311454 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311457 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311460 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311463 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311465 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311468 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311470 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311473 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311477 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311480 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:22.316657 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311483 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:22.311486 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.311490 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.311602 2587 server.go:962] "Client rotation is on, will bootstrap in background" Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.313666 2587 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.314423 2587 server.go:1019] "Starting client certificate rotation" Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.314519 2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.314555 2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 01:39:22.317147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.317046 2587 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 01:39:22.318796 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.318775 2587 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 01:39:22.323884 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.323865 2587 log.go:25] "Validated CRI v1 runtime API" Sep 19 01:39:22.326067 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.326053 2587 log.go:25] "Validated CRI v1 image API" Sep 19 01:39:22.326930 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.326916 2587 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 19 01:39:22.331612 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.331593 2587 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bdba0116-bda6-41e7-be5c-d69d1b5c1543:/dev/nvme0n1p4 ec334c36-f346-4bef-9bf6-a9ca4b417db0:/dev/nvme0n1p3] Sep 19 01:39:22.331676 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.331611 2587 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 19 01:39:22.335659 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.335552 2587 manager.go:216] Machine: {Timestamp:2026-09-19 01:39:22.335087272 +0000 UTC m=+2.067825515 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098255 MemoryCapacity:32812142592 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec254b459fc18928dc5a417b8c13e310 SystemUUID:ec254b45-9fc1-8928-dc5a-417b8c13e310 BootID:f43198d7-5616-4098-a3d8-3da98575131b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406069248 Type:vfs Inodes:4005388 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c8:38:d5:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c8:38:d5:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:a9:7b:00:e8:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812142592 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 19 01:39:22.335659 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.335654 2587 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 19 01:39:22.335760 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.335749 2587 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 19 01:39:22.337629 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.337585 2587 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 19 01:39:22.337927 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.337787 2587 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 19 01:39:22.339055 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.339043 2587 topology_manager.go:138] "Creating topology manager with none policy" Sep 19 01:39:22.339102 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.339057 2587 container_manager_linux.go:309] "Creating device plugin manager" Sep 19 01:39:22.339102 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.339066 2587 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 01:39:22.339102 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.339077 2587 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 01:39:22.339186 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.339146 2587 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 19 01:39:22.343046 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343034 2587 state_mem.go:36] "Initialized new in-memory state store" Sep 19 01:39:22.343167 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343158 2587 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 19 01:39:22.343198 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343185 2587 kubelet.go:486] "Attempting to sync node with API server" Sep 19 01:39:22.343198 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343195 2587 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 19 01:39:22.343247 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343208 2587 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 19 01:39:22.343247 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343218 2587 kubelet.go:398] "Adding apiserver pod source" Sep 19 01:39:22.343247 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343219 2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 01:39:22.343247 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343226 2587 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 19 01:39:22.343633 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343621 2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 01:39:22.343674 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.343643 2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 01:39:22.345777 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.345757 2587 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 19 01:39:22.347719 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.347706 2587 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 19 01:39:22.347768 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.347736 2587 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 19 01:39:22.348756 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348746 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 19 01:39:22.348807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348762 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 19 01:39:22.348807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348775 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 19 01:39:22.348807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348781 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 19 01:39:22.348807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348790 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 19 01:39:22.348807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348795 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 19 01:39:22.348807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348809 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 19 01:39:22.348971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348814 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 19 01:39:22.348971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348819 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 19 01:39:22.348971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348825 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 19 01:39:22.348971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348832 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 19 01:39:22.348971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348838 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 19 01:39:22.348971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348866 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 19 01:39:22.348971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.348871 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 19 01:39:22.352294 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.352283 2587 server.go:1268] "Started kubelet" Sep 19 01:39:22.352378 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.352347 2587 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 19 01:39:22.352456 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.352382 2587 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 19 01:39:22.352552 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.352472 2587 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 19 01:39:22.353099 ip-10-0-139-3 systemd[1]: Started Kubernetes Kubelet. Sep 19 01:39:22.353651 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.353451 2587 server.go:310] "Adding debug handlers to kubelet server" Sep 19 01:39:22.353651 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.353598 2587 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 19 01:39:22.357726 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.357707 2587 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 19 01:39:22.359170 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.359158 2587 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 19 01:39:22.359252 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.359187 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 19 01:39:22.359252 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.359196 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 19 01:39:22.360301 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.360286 2587 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 19 01:39:22.360355 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.360308 2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 19 01:39:22.360407 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.360356 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:22.361257 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.361231 2587 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 19 01:39:22.361341 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.361245 2587 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 19 01:39:22.361341 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.361278 2587 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 19 01:39:22.361445 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.361381 2587 reconstruct.go:97] "Volume reconstruction finished" Sep 19 01:39:22.361445 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.361388 2587 reconciler.go:29] "Reconciler: start to sync state" Sep 19 01:39:22.362496 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.362477 2587 factory.go:55] Registering systemd factory Sep 19 01:39:22.362496 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.362496 2587 factory.go:223] Registration of the systemd container factory successfully Sep 19 01:39:22.362706 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.362694 2587 factory.go:153] Registering CRI-O factory Sep 19 01:39:22.362779 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.362712 2587 factory.go:223] Registration of the crio container factory successfully Sep 19 01:39:22.362779 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.362770 2587 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 19 01:39:22.362852 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.362784 2587 factory.go:103] Registering Raw factory Sep 19 01:39:22.362852 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.362794 2587 manager.go:1196] Started watching for new ooms in manager Sep 19 01:39:22.363066 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.363056 2587 manager.go:349] Starting recovery of all containers Sep 19 01:39:22.363197 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.363178 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 19 01:39:22.363323 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.363305 2587 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 19 01:39:22.385308 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.385282 2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jwq79" Sep 19 01:39:22.385403 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.385310 2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jwq79" Sep 19 01:39:22.392466 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.390518 2587 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-3.ec2.internal.18d695364b686fe8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-3.ec2.internal,UID:ip-10-0-139-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-3.ec2.internal,},FirstTimestamp:2026-09-19 01:39:22.352259048 +0000 UTC m=+2.084997292,LastTimestamp:2026-09-19 01:39:22.352259048 +0000 UTC m=+2.084997292,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-3.ec2.internal,}" Sep 19 01:39:22.393677 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.393626 2587 manager.go:354] Recovery completed Sep 19 01:39:22.397711 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.397697 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:22.399424 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.399401 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:22.399424 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.399427 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:22.399531 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.399436 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:22.399967 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.399955 2587 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 19 01:39:22.400025 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.399966 2587 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 19 01:39:22.400025 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.399984 2587 state_mem.go:36] "Initialized new in-memory state store" Sep 19 01:39:22.400025 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.400005 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:22.400673 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.400659 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:22.400724 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.400680 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:22.400724 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.400689 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:22.402012 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.402000 2587 policy_none.go:49] "None policy: Start" Sep 19 01:39:22.402052 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.402018 2587 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 19 01:39:22.402052 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.402032 2587 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 19 01:39:22.402189 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.402120 2587 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-3.ec2.internal.18d695364e37fcc7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-3.ec2.internal,UID:ip-10-0-139-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-3.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-3.ec2.internal,},FirstTimestamp:2026-09-19 01:39:22.399415495 +0000 UTC m=+2.132153739,LastTimestamp:2026-09-19 01:39:22.399415495 +0000 UTC m=+2.132153739,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-3.ec2.internal,}" Sep 19 01:39:22.404023 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.404012 2587 policy_none.go:47] "Start" Sep 19 01:39:22.439133 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.439119 2587 manager.go:337] "Starting Device Plugin manager" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.439157 2587 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.439166 2587 server.go:87] "Starting device plugin registration server" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.439341 2587 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.439364 2587 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.439502 2587 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.439594 2587 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.439603 2587 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.439996 2587 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 19 01:39:22.460098 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.440037 2587 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:22.508059 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.508039 2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 19 01:39:22.509400 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.509382 2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 19 01:39:22.509478 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.509422 2587 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 19 01:39:22.509478 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.509442 2587 kubelet.go:2448] "Starting kubelet main sync loop" Sep 19 01:39:22.509557 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.509485 2587 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 19 01:39:22.511549 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.511533 2587 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:22.539764 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.539749 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:22.540509 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.540493 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:22.540604 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.540521 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:22.540604 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.540530 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:22.540604 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.540558 2587 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.546541 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.546503 2587 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.546541 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.546523 2587 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-3.ec2.internal\": node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:22.567744 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.567724 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:22.610268 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.610241 2587 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal"] Sep 19 01:39:22.610320 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.610306 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:22.611101 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.611085 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:22.611155 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.611114 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:22.611155 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.611123 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:22.613325 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.613314 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:22.613460 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.613447 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.613499 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.613475 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:22.614744 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.614311 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:22.614744 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.614334 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:22.614744 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.614347 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:22.614744 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.614660 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:22.614744 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.614682 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:22.614744 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.614694 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:22.617366 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.617350 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.617453 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.617373 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:22.618078 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.618060 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:22.618163 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.618091 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:22.618163 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.618105 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:22.639067 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.639045 2587 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-3.ec2.internal\" not found" node="ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.643580 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.643550 2587 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-3.ec2.internal\" not found" node="ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.662341 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.662322 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a13721722462cbacad7a4e1f4ec9e976-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"a13721722462cbacad7a4e1f4ec9e976\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.662395 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.662352 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f088be7bcf4050825a01ace946d9f0d0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-3.ec2.internal\" (UID: \"f088be7bcf4050825a01ace946d9f0d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.662395 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.662372 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a13721722462cbacad7a4e1f4ec9e976-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"a13721722462cbacad7a4e1f4ec9e976\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.668332 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.668316 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:22.763410 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.763390 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a13721722462cbacad7a4e1f4ec9e976-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"a13721722462cbacad7a4e1f4ec9e976\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.763472 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.763415 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a13721722462cbacad7a4e1f4ec9e976-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"a13721722462cbacad7a4e1f4ec9e976\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.763472 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.763439 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f088be7bcf4050825a01ace946d9f0d0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-3.ec2.internal\" (UID: \"f088be7bcf4050825a01ace946d9f0d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.763532 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.763482 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a13721722462cbacad7a4e1f4ec9e976-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"a13721722462cbacad7a4e1f4ec9e976\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.763532 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.763486 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a13721722462cbacad7a4e1f4ec9e976-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"a13721722462cbacad7a4e1f4ec9e976\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.763621 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.763554 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f088be7bcf4050825a01ace946d9f0d0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-3.ec2.internal\" (UID: \"f088be7bcf4050825a01ace946d9f0d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.768510 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.768495 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:22.868856 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.868806 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:22.943009 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.942981 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.946866 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:22.946850 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Sep 19 01:39:22.969210 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:22.969183 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:23.069688 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:23.069657 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:23.170282 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:23.170208 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:23.270658 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:23.270632 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Sep 19 01:39:23.314803 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.314781 2587 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 19 01:39:23.315191 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.314932 2587 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 01:39:23.355311 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.355289 2587 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:23.360721 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.360705 2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Sep 19 01:39:23.360797 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.360737 2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 19 01:39:23.374962 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.374945 2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 01:39:23.376473 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.376459 2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Sep 19 01:39:23.378093 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.378078 2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 01:39:23.388223 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.388208 2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 01:39:23.392354 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.392329 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 01:34:22 +0000 UTC" deadline="2028-02-15 09:36:39.124712984 +0000 UTC" Sep 19 01:39:23.392405 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.392355 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12343h57m15.732361267s" Sep 19 01:39:23.413126 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.413107 2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4qgb" Sep 19 01:39:23.422184 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.422148 2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4qgb" Sep 19 01:39:23.495049 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.494902 2587 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:23.602081 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:23.602047 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf088be7bcf4050825a01ace946d9f0d0.slice/crio-5ebba87bbd74f2ac60c696b8f38529e8fca0a6c0077e0a48c981097b44493543 WatchSource:0}: Error finding container 5ebba87bbd74f2ac60c696b8f38529e8fca0a6c0077e0a48c981097b44493543: Status 404 returned error can't find the container with id 5ebba87bbd74f2ac60c696b8f38529e8fca0a6c0077e0a48c981097b44493543 Sep 19 01:39:23.602426 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:23.602407 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13721722462cbacad7a4e1f4ec9e976.slice/crio-d2fda54ecffd2ef56b61b303f362336591e3a69118d9c0eda32ed1966a01f9cd WatchSource:0}: Error finding container d2fda54ecffd2ef56b61b303f362336591e3a69118d9c0eda32ed1966a01f9cd: Status 404 returned error can't find the container with id d2fda54ecffd2ef56b61b303f362336591e3a69118d9c0eda32ed1966a01f9cd Sep 19 01:39:23.606419 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.606397 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:39:23.870285 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:23.870257 2587 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:24.344614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.344359 2587 apiserver.go:52] "Watching apiserver" Sep 19 01:39:24.353611 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.353586 2587 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 19 01:39:24.354102 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.354079 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg","openshift-cluster-node-tuning-operator/tuned-dsbxs","openshift-dns/node-resolver-dvqqh","openshift-multus/multus-67kn6","openshift-multus/network-metrics-daemon-dxcb4","openshift-ovn-kubernetes/ovnkube-node-5gp6l","kube-system/konnectivity-agent-b6k6z","openshift-image-registry/node-ca-npmxp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal","openshift-multus/multus-additional-cni-plugins-jkmc8","openshift-network-diagnostics/network-check-target-wrbdw","openshift-network-operator/iptables-alerter-z9qv6","kube-system/global-pull-secret-syncer-49pw7"] Sep 19 01:39:24.356666 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.356645 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.359456 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.359003 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.360978 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.360958 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 19 01:39:24.361202 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.361185 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 19 01:39:24.361782 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.361766 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 19 01:39:24.362003 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.361986 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.362661 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.362645 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 19 01:39:24.362929 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.362913 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sdnwr\"" Sep 19 01:39:24.363098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.363079 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 19 01:39:24.363259 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.363242 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 19 01:39:24.366369 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.365864 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.366369 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.365897 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.366369 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.366018 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 19 01:39:24.366369 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.366077 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:39:24.366369 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.366169 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9b26m\"" Sep 19 01:39:24.366369 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.366273 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:39:24.366711 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.366454 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 19 01:39:24.366711 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.366520 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 19 01:39:24.366711 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.366586 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cgqzl\"" Sep 19 01:39:24.368079 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.367914 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:24.368079 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.368015 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:24.369239 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.369222 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 19 01:39:24.369718 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.369562 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 19 01:39:24.369805 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.369781 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7nk92\"" Sep 19 01:39:24.370027 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.370010 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 19 01:39:24.370276 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.370261 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mfgw6\"" Sep 19 01:39:24.370451 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.370435 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 19 01:39:24.371079 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.371061 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 19 01:39:24.371293 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.371275 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 19 01:39:24.371376 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.371303 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.377420 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.376774 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.377420 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.376843 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:24.377420 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377109 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 19 01:39:24.377420 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377221 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 19 01:39:24.377420 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377355 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 19 01:39:24.377743 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377678 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbnln\" (UniqueName: \"kubernetes.io/projected/6c0540d9-57b0-4797-a852-194684138b4a-kube-api-access-rbnln\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.377743 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377713 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysctl-d\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.377743 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377739 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqkvp\" (UniqueName: \"kubernetes.io/projected/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-kube-api-access-tqkvp\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.377904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377770 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-systemd\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.377904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377798 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4bj\" (UniqueName: \"kubernetes.io/projected/480be173-55c0-467c-a043-ced8a09f95d8-kube-api-access-4t4bj\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.377904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377825 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysctl-conf\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.377904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377850 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-lib-modules\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.377904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377872 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.377904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377901 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-env-overrides\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.378127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377927 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-systemd\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.378127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377955 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-tmp\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.378127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.377982 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4934e60f-3b69-4fe2-b79a-1df00778d41e-tmp-dir\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.378127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378008 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhvb\" (UniqueName: \"kubernetes.io/projected/4934e60f-3b69-4fe2-b79a-1df00778d41e-kube-api-access-xqhvb\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.378127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378041 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-systemd-units\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.378127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378077 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-etc-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.378127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378106 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.378495 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378135 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-cni-netd\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.378495 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378333 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4934e60f-3b69-4fe2-b79a-1df00778d41e-hosts-file\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.378495 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378387 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-node-log\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.378495 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378418 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-modprobe-d\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.378495 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378444 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-sys\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.378495 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378477 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-cni-bin\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.378798 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.378509 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c0540d9-57b0-4797-a852-194684138b4a-host-slash\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.380077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.379075 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.380077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.379325 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-var-lib-kubelet\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.380077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.379950 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rfz4b\"" Sep 19 01:39:24.380475 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380446 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-host\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.380592 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380508 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-run-netns\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.380592 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380546 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-ovn\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.380706 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380598 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/480be173-55c0-467c-a043-ced8a09f95d8-ovn-node-metrics-cert\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.380706 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380634 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c0540d9-57b0-4797-a852-194684138b4a-iptables-alerter-script\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.380706 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380696 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-kubernetes\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.380869 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380726 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysconfig\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.380869 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380750 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-slash\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.380869 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380789 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-var-lib-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.380869 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380851 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-log-socket\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.381059 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380889 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-ovnkube-config\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.381059 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380943 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-ovnkube-script-lib\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.381059 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.380988 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-run\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.381059 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.381017 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-tuned\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.381250 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.381079 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-kubelet\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.381250 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.381113 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.382200 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.382180 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.382873 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.382834 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 19 01:39:24.383656 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.383378 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tnrd5\"" Sep 19 01:39:24.383656 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.383403 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 19 01:39:24.384616 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.384594 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 19 01:39:24.384948 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.384929 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.385377 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.385107 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 19 01:39:24.385377 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.385285 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 19 01:39:24.385652 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.385635 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tctzc\"" Sep 19 01:39:24.387233 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.387209 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:24.387358 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.387273 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:24.388307 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.388289 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 19 01:39:24.389125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.389108 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 19 01:39:24.389349 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.389335 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7hnj\"" Sep 19 01:39:24.424822 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.424772 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:34:23 +0000 UTC" deadline="2028-04-24 09:39:33.163160008 +0000 UTC" Sep 19 01:39:24.424822 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.424821 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14000h0m8.738343881s" Sep 19 01:39:24.462486 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.462468 2587 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 19 01:39:24.481328 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481305 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/480be173-55c0-467c-a043-ced8a09f95d8-ovn-node-metrics-cert\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.481461 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481334 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c0540d9-57b0-4797-a852-194684138b4a-iptables-alerter-script\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.481461 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481358 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-kubernetes\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.481461 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481378 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-conf-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.481461 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481394 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysconfig\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.481461 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481412 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-var-lib-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.481461 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481435 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-log-socket\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.481461 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481455 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-run\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481483 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqkvp\" (UniqueName: \"kubernetes.io/projected/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-kube-api-access-tqkvp\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481504 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481530 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481551 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-sys-fs\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481589 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-kubernetes\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481595 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbnln\" (UniqueName: \"kubernetes.io/projected/6c0540d9-57b0-4797-a852-194684138b4a-kube-api-access-rbnln\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481640 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysctl-d\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481665 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481687 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-cni-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481725 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-run\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.481845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481811 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysconfig\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481844 2587 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481904 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-log-socket\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481729 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-cni-bin\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481964 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-systemd\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481988 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c0540d9-57b0-4797-a852-194684138b4a-iptables-alerter-script\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482001 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4bj\" (UniqueName: \"kubernetes.io/projected/480be173-55c0-467c-a043-ced8a09f95d8-kube-api-access-4t4bj\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482055 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnv4\" (UniqueName: \"kubernetes.io/projected/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-kube-api-access-6bnv4\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.481868 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-var-lib-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482179 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d451716-6490-4ed9-9ad9-0cce3ad39280-host\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482189 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-systemd\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482236 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-tmp\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482248 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysctl-d\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482265 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhvb\" (UniqueName: \"kubernetes.io/projected/4934e60f-3b69-4fe2-b79a-1df00778d41e-kube-api-access-xqhvb\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482285 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7f09212-56af-47d0-b7eb-cfefcbb0d916-dbus\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.482312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482300 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-k8s-cni-cncf-io\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482330 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-netns\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482344 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d451716-6490-4ed9-9ad9-0cce3ad39280-serviceca\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482365 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-socket-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482384 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482401 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4934e60f-3b69-4fe2-b79a-1df00778d41e-hosts-file\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482417 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxd7v\" (UniqueName: \"kubernetes.io/projected/89e8356f-a36e-4dbd-85ab-f903e3fc245b-kube-api-access-hxd7v\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482435 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482451 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhl5\" (UniqueName: \"kubernetes.io/projected/6d451716-6490-4ed9-9ad9-0cce3ad39280-kube-api-access-sjhl5\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482468 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-node-log\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482475 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4934e60f-3b69-4fe2-b79a-1df00778d41e-hosts-file\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482485 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-modprobe-d\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482500 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-sys\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482524 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-node-log\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482537 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-sys\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482543 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-modprobe-d\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482562 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7f09212-56af-47d0-b7eb-cfefcbb0d916-kubelet-config\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.483149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482631 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-system-cni-dir\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.482656 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483165 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-cni-bin\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483190 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c0540d9-57b0-4797-a852-194684138b4a-host-slash\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483219 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-multus-certs\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483245 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqpx\" (UniqueName: \"kubernetes.io/projected/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-kube-api-access-bhqpx\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483272 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-run-netns\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483297 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483321 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqz4x\" (UniqueName: \"kubernetes.io/projected/08b545de-27d7-46fa-9195-3782f8cd7f21-kube-api-access-rqz4x\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483344 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-device-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483370 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-slash\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483395 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-ovnkube-config\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483429 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-ovnkube-script-lib\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483452 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-tuned\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483479 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483503 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-registration-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.483963 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483527 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-kubelet\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483550 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483595 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysctl-conf\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483627 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-lib-modules\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483630 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-cni-bin\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483662 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c0540d9-57b0-4797-a852-194684138b4a-host-slash\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483652 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-socket-dir-parent\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483695 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483787 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-slash\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483837 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-kubelet\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483876 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.483991 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-sysctl-conf\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484074 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-lib-modules\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484134 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-ovnkube-config\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484188 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-run-netns\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484597 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-ovnkube-script-lib\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484698 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-env-overrides\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.484742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484729 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-systemd\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484752 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4934e60f-3b69-4fe2-b79a-1df00778d41e-tmp-dir\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484839 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cnibin\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484865 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-hostroot\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484890 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-daemon-config\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484917 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-systemd-units\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.484948 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-etc-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485004 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485028 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-cni-netd\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485051 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-cnibin\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485075 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-cni-multus\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485099 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-etc-kubernetes\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485124 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-system-cni-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485180 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485208 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8ce8216-8b0d-4de5-a84f-b1443048bd71-konnectivity-ca\") pod \"konnectivity-agent-b6k6z\" (UID: \"f8ce8216-8b0d-4de5-a84f-b1443048bd71\") " pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485235 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-var-lib-kubelet\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485261 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-host\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.485560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485341 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-cni-binary-copy\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485367 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-kubelet\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485393 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8ce8216-8b0d-4de5-a84f-b1443048bd71-agent-certs\") pod \"konnectivity-agent-b6k6z\" (UID: \"f8ce8216-8b0d-4de5-a84f-b1443048bd71\") " pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485419 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-ovn\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485503 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-ovn\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485545 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-host\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485597 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-etc-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485875 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4934e60f-3b69-4fe2-b79a-1df00778d41e-tmp-dir\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.485929 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486075 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-systemd\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486120 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-systemd-units\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486154 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-run-openvswitch\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486182 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/480be173-55c0-467c-a043-ced8a09f95d8-host-cni-netd\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486225 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-var-lib-kubelet\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486285 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/480be173-55c0-467c-a043-ced8a09f95d8-env-overrides\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486374 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486350 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/480be173-55c0-467c-a043-ced8a09f95d8-ovn-node-metrics-cert\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.486962 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.486608 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-tmp\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.487435 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.487409 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-etc-tuned\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.488663 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.488639 2587 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:24.490646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.490553 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbnln\" (UniqueName: \"kubernetes.io/projected/6c0540d9-57b0-4797-a852-194684138b4a-kube-api-access-rbnln\") pod \"iptables-alerter-z9qv6\" (UID: \"6c0540d9-57b0-4797-a852-194684138b4a\") " pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.491107 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.491084 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhvb\" (UniqueName: \"kubernetes.io/projected/4934e60f-3b69-4fe2-b79a-1df00778d41e-kube-api-access-xqhvb\") pod \"node-resolver-dvqqh\" (UID: \"4934e60f-3b69-4fe2-b79a-1df00778d41e\") " pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.494586 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.491746 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqkvp\" (UniqueName: \"kubernetes.io/projected/5e852a5b-ac1d-4033-9acf-6e99e2ba05de-kube-api-access-tqkvp\") pod \"tuned-dsbxs\" (UID: \"5e852a5b-ac1d-4033-9acf-6e99e2ba05de\") " pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.494586 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.492683 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4bj\" (UniqueName: \"kubernetes.io/projected/480be173-55c0-467c-a043-ced8a09f95d8-kube-api-access-4t4bj\") pod \"ovnkube-node-5gp6l\" (UID: \"480be173-55c0-467c-a043-ced8a09f95d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.514416 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.514320 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" event={"ID":"a13721722462cbacad7a4e1f4ec9e976","Type":"ContainerStarted","Data":"d2fda54ecffd2ef56b61b303f362336591e3a69118d9c0eda32ed1966a01f9cd"} Sep 19 01:39:24.515760 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.515737 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" event={"ID":"f088be7bcf4050825a01ace946d9f0d0","Type":"ContainerStarted","Data":"5ebba87bbd74f2ac60c696b8f38529e8fca0a6c0077e0a48c981097b44493543"} Sep 19 01:39:24.586146 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586113 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnv4\" (UniqueName: \"kubernetes.io/projected/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-kube-api-access-6bnv4\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.586298 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586154 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d451716-6490-4ed9-9ad9-0cce3ad39280-host\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.586298 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586181 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7f09212-56af-47d0-b7eb-cfefcbb0d916-dbus\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.586298 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586234 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d451716-6490-4ed9-9ad9-0cce3ad39280-host\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.586298 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586273 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-k8s-cni-cncf-io\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586301 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-netns\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586321 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d451716-6490-4ed9-9ad9-0cce3ad39280-serviceca\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586333 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7f09212-56af-47d0-b7eb-cfefcbb0d916-dbus\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586339 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-socket-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586373 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586385 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-netns\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586401 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxd7v\" (UniqueName: \"kubernetes.io/projected/89e8356f-a36e-4dbd-85ab-f903e3fc245b-kube-api-access-hxd7v\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586427 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586432 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-k8s-cni-cncf-io\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586450 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhl5\" (UniqueName: \"kubernetes.io/projected/6d451716-6490-4ed9-9ad9-0cce3ad39280-kube-api-access-sjhl5\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586477 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7f09212-56af-47d0-b7eb-cfefcbb0d916-kubelet-config\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.586501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586502 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-system-cni-dir\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.586513 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586526 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586552 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-multus-certs\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.586595 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:25.086552078 +0000 UTC m=+4.819290331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586654 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqpx\" (UniqueName: \"kubernetes.io/projected/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-kube-api-access-bhqpx\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586681 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586705 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqz4x\" (UniqueName: \"kubernetes.io/projected/08b545de-27d7-46fa-9195-3782f8cd7f21-kube-api-access-rqz4x\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586730 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-device-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586757 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586757 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-system-cni-dir\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586758 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586810 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-registration-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586840 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-socket-dir-parent\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586841 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d451716-6490-4ed9-9ad9-0cce3ad39280-serviceca\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586867 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cnibin\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.587098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586902 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cnibin\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586902 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-hostroot\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586451 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-socket-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586933 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-daemon-config\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586939 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-hostroot\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586963 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-cnibin\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586976 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7f09212-56af-47d0-b7eb-cfefcbb0d916-kubelet-config\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.586988 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-cni-multus\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587012 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-etc-kubernetes\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587017 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-socket-dir-parent\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587021 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-registration-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587034 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-system-cni-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587063 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587086 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8ce8216-8b0d-4de5-a84f-b1443048bd71-konnectivity-ca\") pod \"konnectivity-agent-b6k6z\" (UID: \"f8ce8216-8b0d-4de5-a84f-b1443048bd71\") " pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587112 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-cni-binary-copy\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587135 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-kubelet\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587159 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8ce8216-8b0d-4de5-a84f-b1443048bd71-agent-certs\") pod \"konnectivity-agent-b6k6z\" (UID: \"f8ce8216-8b0d-4de5-a84f-b1443048bd71\") " pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587186 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-conf-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.587897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587203 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-run-multus-certs\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587216 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587240 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587263 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-sys-fs\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587289 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587312 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-cni-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587317 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587335 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-cni-bin\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587393 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-cnibin\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587410 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-cni-bin\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587431 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-cni-multus\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587460 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89e8356f-a36e-4dbd-85ab-f903e3fc245b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587466 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-etc-kubernetes\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587504 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-system-cni-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587511 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587552 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-device-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.587717 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-host-var-lib-kubelet\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.588758 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588011 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8ce8216-8b0d-4de5-a84f-b1443048bd71-konnectivity-ca\") pod \"konnectivity-agent-b6k6z\" (UID: \"f8ce8216-8b0d-4de5-a84f-b1443048bd71\") " pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588038 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89e8356f-a36e-4dbd-85ab-f903e3fc245b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588071 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-daemon-config\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588118 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-cni-binary-copy\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588134 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-sys-fs\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.588179 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588185 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-cni-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588189 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-multus-conf-dir\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.588213 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret podName:a7f09212-56af-47d0-b7eb-cfefcbb0d916 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:25.088202372 +0000 UTC m=+4.820940602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret") pod "global-pull-secret-syncer-49pw7" (UID: "a7f09212-56af-47d0-b7eb-cfefcbb0d916") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:24.589548 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.588231 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.592627 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.592605 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8ce8216-8b0d-4de5-a84f-b1443048bd71-agent-certs\") pod \"konnectivity-agent-b6k6z\" (UID: \"f8ce8216-8b0d-4de5-a84f-b1443048bd71\") " pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.596762 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.596614 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:24.596762 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.596643 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:24.596762 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.596656 2587 projected.go:196] Error preparing data for projected volume kube-api-access-wn277 for pod openshift-network-diagnostics/network-check-target-wrbdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:24.596762 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:24.596712 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277 podName:e1d86922-3f83-461c-aa42-80912ea228f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:25.096696775 +0000 UTC m=+4.829435025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wn277" (UniqueName: "kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277") pod "network-check-target-wrbdw" (UID: "e1d86922-3f83-461c-aa42-80912ea228f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:24.602140 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.602118 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhl5\" (UniqueName: \"kubernetes.io/projected/6d451716-6490-4ed9-9ad9-0cce3ad39280-kube-api-access-sjhl5\") pod \"node-ca-npmxp\" (UID: \"6d451716-6490-4ed9-9ad9-0cce3ad39280\") " pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.602231 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.602140 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqpx\" (UniqueName: \"kubernetes.io/projected/90fa2fb5-9e4d-43d9-a573-b4101342cfd6-kube-api-access-bhqpx\") pod \"aws-ebs-csi-driver-node-gxkgg\" (UID: \"90fa2fb5-9e4d-43d9-a573-b4101342cfd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.602348 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.602329 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqz4x\" (UniqueName: \"kubernetes.io/projected/08b545de-27d7-46fa-9195-3782f8cd7f21-kube-api-access-rqz4x\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:24.602516 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.602499 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxd7v\" (UniqueName: \"kubernetes.io/projected/89e8356f-a36e-4dbd-85ab-f903e3fc245b-kube-api-access-hxd7v\") pod \"multus-additional-cni-plugins-jkmc8\" (UID: \"89e8356f-a36e-4dbd-85ab-f903e3fc245b\") " pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:24.604458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.604434 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnv4\" (UniqueName: \"kubernetes.io/projected/ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16-kube-api-access-6bnv4\") pod \"multus-67kn6\" (UID: \"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16\") " pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.677961 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.677931 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:24.698020 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.697997 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9qv6" Sep 19 01:39:24.703842 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.703818 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" Sep 19 01:39:24.709534 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.709514 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dvqqh" Sep 19 01:39:24.717166 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.717149 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-67kn6" Sep 19 01:39:24.723811 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.723792 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-npmxp" Sep 19 01:39:24.733282 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.733262 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" Sep 19 01:39:24.739882 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.739865 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:24.745350 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:24.745335 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" Sep 19 01:39:25.091918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.091882 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:25.092103 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.091950 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:25.092103 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.092052 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:25.092216 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.092124 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:26.09210413 +0000 UTC m=+5.824842362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:25.092216 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.092057 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:25.092216 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.092192 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret podName:a7f09212-56af-47d0-b7eb-cfefcbb0d916 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:26.092180201 +0000 UTC m=+5.824918432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret") pod "global-pull-secret-syncer-49pw7" (UID: "a7f09212-56af-47d0-b7eb-cfefcbb0d916") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:25.192833 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.192797 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:25.193017 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.192997 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:25.193017 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.193021 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:25.193163 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.193034 2587 projected.go:196] Error preparing data for projected volume kube-api-access-wn277 for pod openshift-network-diagnostics/network-check-target-wrbdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:25.193163 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.193104 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277 podName:e1d86922-3f83-461c-aa42-80912ea228f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:26.193085468 +0000 UTC m=+5.925823720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn277" (UniqueName: "kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277") pod "network-check-target-wrbdw" (UID: "e1d86922-3f83-461c-aa42-80912ea228f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:25.426714 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.426608 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:34:23 +0000 UTC" deadline="2028-05-07 14:46:32.705024397 +0000 UTC" Sep 19 01:39:25.426714 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.426672 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14317h7m7.278357415s" Sep 19 01:39:25.495145 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.495119 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480be173_55c0_467c_a043_ced8a09f95d8.slice/crio-70447ffefd1c4b4138608e495edb2a335d7d757f62b80952579923544f5d62aa WatchSource:0}: Error finding container 70447ffefd1c4b4138608e495edb2a335d7d757f62b80952579923544f5d62aa: Status 404 returned error can't find the container with id 70447ffefd1c4b4138608e495edb2a335d7d757f62b80952579923544f5d62aa Sep 19 01:39:25.497375 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.497355 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e8356f_a36e_4dbd_85ab_f903e3fc245b.slice/crio-bee9087607a105e10430886aac46423e8ffc252f70e0eeb54d234ef3eac4ed4d WatchSource:0}: Error finding container bee9087607a105e10430886aac46423e8ffc252f70e0eeb54d234ef3eac4ed4d: Status 404 returned error can't find the container with id bee9087607a105e10430886aac46423e8ffc252f70e0eeb54d234ef3eac4ed4d Sep 19 01:39:25.498156 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.498137 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d451716_6490_4ed9_9ad9_0cce3ad39280.slice/crio-6460adda79c782c68edab5f2100b60717625ebe09fef0e4e19d227f42f1fbec0 WatchSource:0}: Error finding container 6460adda79c782c68edab5f2100b60717625ebe09fef0e4e19d227f42f1fbec0: Status 404 returned error can't find the container with id 6460adda79c782c68edab5f2100b60717625ebe09fef0e4e19d227f42f1fbec0 Sep 19 01:39:25.499527 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.499262 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0540d9_57b0_4797_a852_194684138b4a.slice/crio-ef3d626dc659a6e34ca131f12e43b813447722c7ddcdf87543d6ce8aced163f9 WatchSource:0}: Error finding container ef3d626dc659a6e34ca131f12e43b813447722c7ddcdf87543d6ce8aced163f9: Status 404 returned error can't find the container with id ef3d626dc659a6e34ca131f12e43b813447722c7ddcdf87543d6ce8aced163f9 Sep 19 01:39:25.502118 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.502052 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ce8216_8b0d_4de5_a84f_b1443048bd71.slice/crio-2e5a125b0ad4b29913fd11c6a4e4c25dba827482aa0bc8af4bfe157a557e04cf WatchSource:0}: Error finding container 2e5a125b0ad4b29913fd11c6a4e4c25dba827482aa0bc8af4bfe157a557e04cf: Status 404 returned error can't find the container with id 2e5a125b0ad4b29913fd11c6a4e4c25dba827482aa0bc8af4bfe157a557e04cf Sep 19 01:39:25.503211 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.503189 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fa2fb5_9e4d_43d9_a573_b4101342cfd6.slice/crio-44bbfcc12b96fe4dde8adaf136b422cae7567eb3755ba58f2184e1dc15490e1f WatchSource:0}: Error finding container 44bbfcc12b96fe4dde8adaf136b422cae7567eb3755ba58f2184e1dc15490e1f: Status 404 returned error can't find the container with id 44bbfcc12b96fe4dde8adaf136b422cae7567eb3755ba58f2184e1dc15490e1f Sep 19 01:39:25.503827 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.503806 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e852a5b_ac1d_4033_9acf_6e99e2ba05de.slice/crio-341f8a03c6a8c782e43f57468d1bfcf7eac3a68be015072f423531580e7c29df WatchSource:0}: Error finding container 341f8a03c6a8c782e43f57468d1bfcf7eac3a68be015072f423531580e7c29df: Status 404 returned error can't find the container with id 341f8a03c6a8c782e43f57468d1bfcf7eac3a68be015072f423531580e7c29df Sep 19 01:39:25.506103 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:25.505832 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4934e60f_3b69_4fe2_b79a_1df00778d41e.slice/crio-f1e0d2ea566049616ccc82adc9aafd5a92fade675301d96563c9fc7a852c28d2 WatchSource:0}: Error finding container f1e0d2ea566049616ccc82adc9aafd5a92fade675301d96563c9fc7a852c28d2: Status 404 returned error can't find the container with id f1e0d2ea566049616ccc82adc9aafd5a92fade675301d96563c9fc7a852c28d2 Sep 19 01:39:25.509703 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.509678 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:25.509835 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:25.509812 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:25.519613 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.519587 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" event={"ID":"5e852a5b-ac1d-4033-9acf-6e99e2ba05de","Type":"ContainerStarted","Data":"341f8a03c6a8c782e43f57468d1bfcf7eac3a68be015072f423531580e7c29df"} Sep 19 01:39:25.520821 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.520801 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dvqqh" event={"ID":"4934e60f-3b69-4fe2-b79a-1df00778d41e","Type":"ContainerStarted","Data":"f1e0d2ea566049616ccc82adc9aafd5a92fade675301d96563c9fc7a852c28d2"} Sep 19 01:39:25.522011 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.521987 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-67kn6" event={"ID":"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16","Type":"ContainerStarted","Data":"acc924de44804ce3a733d920fe55c3956e22d34346c3edd1c4da074b42718838"} Sep 19 01:39:25.523230 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.523188 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-npmxp" event={"ID":"6d451716-6490-4ed9-9ad9-0cce3ad39280","Type":"ContainerStarted","Data":"6460adda79c782c68edab5f2100b60717625ebe09fef0e4e19d227f42f1fbec0"} Sep 19 01:39:25.524447 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.524423 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerStarted","Data":"bee9087607a105e10430886aac46423e8ffc252f70e0eeb54d234ef3eac4ed4d"} Sep 19 01:39:25.525720 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.525669 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" event={"ID":"90fa2fb5-9e4d-43d9-a573-b4101342cfd6","Type":"ContainerStarted","Data":"44bbfcc12b96fe4dde8adaf136b422cae7567eb3755ba58f2184e1dc15490e1f"} Sep 19 01:39:25.526852 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.526832 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b6k6z" event={"ID":"f8ce8216-8b0d-4de5-a84f-b1443048bd71","Type":"ContainerStarted","Data":"2e5a125b0ad4b29913fd11c6a4e4c25dba827482aa0bc8af4bfe157a557e04cf"} Sep 19 01:39:25.527951 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.527931 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9qv6" event={"ID":"6c0540d9-57b0-4797-a852-194684138b4a","Type":"ContainerStarted","Data":"ef3d626dc659a6e34ca131f12e43b813447722c7ddcdf87543d6ce8aced163f9"} Sep 19 01:39:25.529116 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:25.529082 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"70447ffefd1c4b4138608e495edb2a335d7d757f62b80952579923544f5d62aa"} Sep 19 01:39:26.100868 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.100761 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:26.101024 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.100867 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:26.101024 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.100997 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:26.101131 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.101061 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret podName:a7f09212-56af-47d0-b7eb-cfefcbb0d916 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:28.101041192 +0000 UTC m=+7.833779439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret") pod "global-pull-secret-syncer-49pw7" (UID: "a7f09212-56af-47d0-b7eb-cfefcbb0d916") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:26.101538 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.101498 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:26.101691 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.101553 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:28.101536865 +0000 UTC m=+7.834275097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:26.201721 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.201681 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:26.201903 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.201887 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:26.201965 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.201910 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:26.201965 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.201924 2587 projected.go:196] Error preparing data for projected volume kube-api-access-wn277 for pod openshift-network-diagnostics/network-check-target-wrbdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:26.202065 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.201983 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277 podName:e1d86922-3f83-461c-aa42-80912ea228f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:28.20196474 +0000 UTC m=+7.934702977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn277" (UniqueName: "kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277") pod "network-check-target-wrbdw" (UID: "e1d86922-3f83-461c-aa42-80912ea228f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:26.512239 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.512176 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:26.513045 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.512296 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:26.513045 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.512692 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:26.513045 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:26.512806 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:26.560776 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.560292 2587 generic.go:356] "Generic (PLEG): container finished" podID="a13721722462cbacad7a4e1f4ec9e976" containerID="53e3a8d75aab44e122caf244cb1e66aa76847f5da24d621e59c3a57edeacd21f" exitCode=0 Sep 19 01:39:26.560776 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.560375 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" event={"ID":"a13721722462cbacad7a4e1f4ec9e976","Type":"ContainerDied","Data":"53e3a8d75aab44e122caf244cb1e66aa76847f5da24d621e59c3a57edeacd21f"} Sep 19 01:39:26.563265 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.562885 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" event={"ID":"f088be7bcf4050825a01ace946d9f0d0","Type":"ContainerStarted","Data":"cd58f2697bfb77844e74d9f0560c6ff55981c586cb5a16cbcd4b8c8f2544ee6f"} Sep 19 01:39:26.596904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:26.596264 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" podStartSLOduration=3.59624356 podStartE2EDuration="3.59624356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:26.595707835 +0000 UTC m=+6.328446089" watchObservedRunningTime="2026-09-19 01:39:26.59624356 +0000 UTC m=+6.328981814" Sep 19 01:39:27.509938 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:27.509886 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:27.510110 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:27.510012 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:27.575554 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:27.575460 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" event={"ID":"a13721722462cbacad7a4e1f4ec9e976","Type":"ContainerStarted","Data":"51d0c03abc6d6bd661a1a66627fa0b15c18d40fd6b794b244de497f80883328c"} Sep 19 01:39:27.593380 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:27.592608 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" podStartSLOduration=4.592588744 podStartE2EDuration="4.592588744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:27.592103031 +0000 UTC m=+7.324841285" watchObservedRunningTime="2026-09-19 01:39:27.592588744 +0000 UTC m=+7.325327001" Sep 19 01:39:28.117088 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:28.116980 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:28.117088 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:28.117034 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:28.117297 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.117171 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:28.117297 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.117229 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:32.117212381 +0000 UTC m=+11.849950618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:28.117677 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.117653 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:28.117766 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.117722 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret podName:a7f09212-56af-47d0-b7eb-cfefcbb0d916 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:32.117703659 +0000 UTC m=+11.850441909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret") pod "global-pull-secret-syncer-49pw7" (UID: "a7f09212-56af-47d0-b7eb-cfefcbb0d916") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:28.217486 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:28.217450 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:28.217680 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.217663 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:28.217757 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.217690 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:28.217757 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.217703 2587 projected.go:196] Error preparing data for projected volume kube-api-access-wn277 for pod openshift-network-diagnostics/network-check-target-wrbdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:28.217851 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.217760 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277 podName:e1d86922-3f83-461c-aa42-80912ea228f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:32.217741839 +0000 UTC m=+11.950480088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn277" (UniqueName: "kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277") pod "network-check-target-wrbdw" (UID: "e1d86922-3f83-461c-aa42-80912ea228f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:28.511681 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:28.511654 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:28.511681 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:28.511679 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:28.511923 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.511771 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:28.511923 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:28.511871 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:29.510423 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:29.509815 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:29.510423 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:29.509941 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:30.511338 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:30.510710 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:30.511338 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:30.510737 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:30.511338 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:30.510859 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:30.511338 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:30.511294 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:31.509666 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:31.509629 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:31.509859 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:31.509748 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:32.151343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:32.150431 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:32.151343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:32.150489 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:32.151343 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.150675 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:32.151343 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.150751 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.150731559 +0000 UTC m=+19.883469793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:32.151343 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.151145 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:32.151343 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.151189 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret podName:a7f09212-56af-47d0-b7eb-cfefcbb0d916 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.151174957 +0000 UTC m=+19.883913194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret") pod "global-pull-secret-syncer-49pw7" (UID: "a7f09212-56af-47d0-b7eb-cfefcbb0d916") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:32.251204 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:32.251156 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:32.251360 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.251329 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:32.251360 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.251347 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:32.251360 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.251359 2587 projected.go:196] Error preparing data for projected volume kube-api-access-wn277 for pod openshift-network-diagnostics/network-check-target-wrbdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:32.251518 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.251434 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277 podName:e1d86922-3f83-461c-aa42-80912ea228f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.251396829 +0000 UTC m=+19.984135061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn277" (UniqueName: "kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277") pod "network-check-target-wrbdw" (UID: "e1d86922-3f83-461c-aa42-80912ea228f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:32.510402 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:32.510361 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:32.510583 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.510474 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:32.510868 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:32.510838 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:32.510994 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:32.510916 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:33.510502 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:33.510469 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:33.511002 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:33.510562 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:34.509777 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:34.509746 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:34.509940 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:34.509893 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:34.510022 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:34.509948 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:34.510097 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:34.510067 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:35.510104 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:35.510063 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:35.510521 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:35.510185 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:36.509775 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:36.509737 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:36.509971 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:36.509883 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:36.509971 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:36.509932 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:36.510094 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:36.510042 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:37.509887 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:37.509852 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:37.510327 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:37.509959 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:38.509849 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:38.509815 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:38.510033 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:38.509813 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:38.510033 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:38.509960 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:38.510033 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:38.510011 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:39.510379 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:39.510346 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:39.510905 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:39.510456 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:40.207692 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:40.207653 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:40.207879 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:40.207699 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:40.207879 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.207831 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:40.207879 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.207832 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:40.208031 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.207898 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:56.207879041 +0000 UTC m=+35.940617278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:40.208031 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.207913 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret podName:a7f09212-56af-47d0-b7eb-cfefcbb0d916 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:56.207906745 +0000 UTC m=+35.940644975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret") pod "global-pull-secret-syncer-49pw7" (UID: "a7f09212-56af-47d0-b7eb-cfefcbb0d916") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:40.308285 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:40.308257 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:40.308471 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.308406 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:40.308471 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.308425 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:40.308471 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.308437 2587 projected.go:196] Error preparing data for projected volume kube-api-access-wn277 for pod openshift-network-diagnostics/network-check-target-wrbdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:40.308647 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.308498 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277 podName:e1d86922-3f83-461c-aa42-80912ea228f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:56.308479392 +0000 UTC m=+36.041217623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn277" (UniqueName: "kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277") pod "network-check-target-wrbdw" (UID: "e1d86922-3f83-461c-aa42-80912ea228f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:40.510617 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:40.510531 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:40.510617 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:40.510542 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:40.511046 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.510679 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:40.511046 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:40.510812 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:41.509765 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:41.509605 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:41.509765 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:41.509733 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:42.510754 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:42.510721 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:42.511192 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:42.510830 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:42.511192 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:42.510886 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:42.511192 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:42.511004 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:43.509955 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.509932 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:43.510083 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:43.510064 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:43.610839 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.610743 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"93cfa33e19bcaaf89e1af5e9b63194eb5cccf569c4187e469b5fb976b6aac956"} Sep 19 01:39:43.612732 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.612703 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" event={"ID":"5e852a5b-ac1d-4033-9acf-6e99e2ba05de","Type":"ContainerStarted","Data":"ee2b2fa83d02e96f8ba46897dbe522cd3ead929cdbf058677f166f7a84ffce2b"} Sep 19 01:39:43.614210 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.614182 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dvqqh" event={"ID":"4934e60f-3b69-4fe2-b79a-1df00778d41e","Type":"ContainerStarted","Data":"d3917e71989532442aebbd6af86cb687bd8143a144adc457bf545a499be510d7"} Sep 19 01:39:43.615536 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.615508 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-67kn6" event={"ID":"ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16","Type":"ContainerStarted","Data":"677a87b50785b9ab54ea530c569d8a92ef7b22db3029f22ca4001aba3ad9364d"} Sep 19 01:39:43.617111 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.617092 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-npmxp" event={"ID":"6d451716-6490-4ed9-9ad9-0cce3ad39280","Type":"ContainerStarted","Data":"dbffed060c3a0f5b21b3d7bcd0177af6e416ef5654a72762714cc8c1ba4d2700"} Sep 19 01:39:43.618538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.618506 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerStarted","Data":"eb0c70bc403cfc608e094fb44338aa1b120b98e22d742610412e3c5953755f95"} Sep 19 01:39:43.620203 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.620180 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" event={"ID":"90fa2fb5-9e4d-43d9-a573-b4101342cfd6","Type":"ContainerStarted","Data":"35293d4adfc89f658c56114b1b4c02dec5653c501a46380444aed2ae663c1b48"} Sep 19 01:39:43.621536 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.621516 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b6k6z" event={"ID":"f8ce8216-8b0d-4de5-a84f-b1443048bd71","Type":"ContainerStarted","Data":"d907132261ddc5b9965391cc61d9f21a1eb71df77d0f7b4985bce952fbb6067d"} Sep 19 01:39:43.629332 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.629297 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dsbxs" podStartSLOduration=3.895160381 podStartE2EDuration="21.629287235s" totalImagesPullingTime="17.734126854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:43.629140238 +0000 UTC m=+23.361878490" watchObservedRunningTime="2026-09-19 01:39:43.629287235 +0000 UTC m=+23.362025488" Sep 19 01:39:43.663905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.663867 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dvqqh" podStartSLOduration=3.93331041 podStartE2EDuration="21.663854899s" totalImagesPullingTime="17.730544489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:43.663796177 +0000 UTC m=+23.396534430" watchObservedRunningTime="2026-09-19 01:39:43.663854899 +0000 UTC m=+23.396593152" Sep 19 01:39:43.682673 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.682634 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-67kn6" podStartSLOduration=3.907091252 podStartE2EDuration="21.682621719s" totalImagesPullingTime="17.775530467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:43.682540113 +0000 UTC m=+23.415278376" watchObservedRunningTime="2026-09-19 01:39:43.682621719 +0000 UTC m=+23.415359972" Sep 19 01:39:43.697829 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.697674 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-npmxp" podStartSLOduration=3.957149597 podStartE2EDuration="21.697660775s" totalImagesPullingTime="17.740511178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:43.697651538 +0000 UTC m=+23.430389781" watchObservedRunningTime="2026-09-19 01:39:43.697660775 +0000 UTC m=+23.430399021" Sep 19 01:39:43.713112 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.713054 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b6k6z" podStartSLOduration=8.30003574 podStartE2EDuration="21.7130331s" totalImagesPullingTime="13.41299736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:43.712497819 +0000 UTC m=+23.445236087" watchObservedRunningTime="2026-09-19 01:39:43.7130331 +0000 UTC m=+23.445771365" Sep 19 01:39:43.844908 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.844866 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:43.911005 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:43.910983 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:44.510373 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.510217 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:44.510451 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.510289 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:44.510451 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:44.510440 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:44.510581 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:44.510531 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:44.625477 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.625448 2587 generic.go:356] "Generic (PLEG): container finished" podID="89e8356f-a36e-4dbd-85ab-f903e3fc245b" containerID="eb0c70bc403cfc608e094fb44338aa1b120b98e22d742610412e3c5953755f95" exitCode=0 Sep 19 01:39:44.626141 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.625530 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerDied","Data":"eb0c70bc403cfc608e094fb44338aa1b120b98e22d742610412e3c5953755f95"} Sep 19 01:39:44.627395 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.627378 2587 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 19 01:39:44.627788 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.627768 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" event={"ID":"90fa2fb5-9e4d-43d9-a573-b4101342cfd6","Type":"ContainerStarted","Data":"84bc02bc5dcd5c2d488efe1f4b12c19988f33103b5828800230e0b67423710d1"} Sep 19 01:39:44.629316 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.629285 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9qv6" event={"ID":"6c0540d9-57b0-4797-a852-194684138b4a","Type":"ContainerStarted","Data":"fd4bbcb5913abb5ac1a363f8b1c0bdff1982a9c529bbcd5ad7cf2bf1ee06e7a4"} Sep 19 01:39:44.632510 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.632493 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:39:44.632846 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.632824 2587 generic.go:356] "Generic (PLEG): container finished" podID="480be173-55c0-467c-a043-ced8a09f95d8" containerID="512bb3f21dacaf7c6ea6c39d1a75c0368e8f4864a538bfcb9756a006a322f1bb" exitCode=1 Sep 19 01:39:44.632952 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.632852 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"8cd137172ca0a40e0446730e66b6a567b04aea0ea8670b21b648629fb35bfb20"} Sep 19 01:39:44.632952 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.632919 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"8ed6ffa54134448fb0e7faa328be057cc2b6f407d9910e3973686bce487fb620"} Sep 19 01:39:44.633069 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.632972 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"88825146ace02d42167e8c4e63eac76eb0789c347e468d5239fdadfc71a5bc3a"} Sep 19 01:39:44.633069 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.633011 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"1fb1df1fde6cf7215636743860b2c76c396455792939184bf7880434ab45f1c0"} Sep 19 01:39:44.633069 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.633044 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerDied","Data":"512bb3f21dacaf7c6ea6c39d1a75c0368e8f4864a538bfcb9756a006a322f1bb"} Sep 19 01:39:44.790830 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.790779 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:44.884198 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:44.884142 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:45.258853 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.258820 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:45.451863 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.451767 2587 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T01:39:44.627390479Z","UUID":"dda5bbaa-b5cd-45f2-977c-f68488de7958","Handler":null,"Name":"","Endpoint":""} Sep 19 01:39:45.453679 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.453656 2587 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 19 01:39:45.453799 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.453691 2587 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 19 01:39:45.510335 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.510277 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:45.510433 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:45.510403 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:45.625122 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.625093 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:45.637249 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.637220 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" event={"ID":"90fa2fb5-9e4d-43d9-a573-b4101342cfd6","Type":"ContainerStarted","Data":"52f4ebc3b7ee2be8fe2eb41f427524ca5f283fb2c387247239aee6b5cfbe47fb"} Sep 19 01:39:45.656072 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.656028 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z9qv6" podStartSLOduration=5.963485954 podStartE2EDuration="23.656012828s" totalImagesPullingTime="17.692526874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:44.663514592 +0000 UTC m=+24.396252845" watchObservedRunningTime="2026-09-19 01:39:45.656012828 +0000 UTC m=+25.388751063" Sep 19 01:39:45.656226 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.656189 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxkgg" podStartSLOduration=4.118035522 podStartE2EDuration="23.656180887s" totalImagesPullingTime="19.538145365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:45.656163613 +0000 UTC m=+25.388901879" watchObservedRunningTime="2026-09-19 01:39:45.656180887 +0000 UTC m=+25.388919142" Sep 19 01:39:45.729348 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:45.729314 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:46.053595 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:46.053548 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:46.120754 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:46.120710 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:46.510459 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:46.510423 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:46.510634 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:46.510558 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:46.510704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:46.510661 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:46.510821 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:46.510797 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:46.643189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:46.643160 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:39:46.643616 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:46.643538 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"fe6399d09e0f20ebffcc8d88f249a9685d333da2f10dccc864aa9055bc8869e7"} Sep 19 01:39:46.953083 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:46.953046 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:47.510086 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:47.510051 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:47.510262 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:47.510192 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:48.349715 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.349508 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:48.350251 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.350229 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:48.374315 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.374284 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:48.439728 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.439695 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:48.512847 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.512825 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:48.513000 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:48.512928 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:48.513000 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.512972 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:48.513111 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:48.513069 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:48.648876 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.648813 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b6k6z" Sep 19 01:39:48.725696 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:48.725662 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:49.510073 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:49.509972 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:49.510596 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:49.510076 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:49.652858 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:49.652823 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerStarted","Data":"8d4d18586332deef83f04ee31d9f3aa91febeda047495c838a47faae89dab482"} Sep 19 01:39:49.656590 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:49.656550 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:39:49.657025 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:49.657002 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"cc81378336245a3ecea3285ad6b811da7f19f7bd2f12e5055c1cec4773e97c12"} Sep 19 01:39:49.657484 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:49.657465 2587 scope.go:117] "RemoveContainer" containerID="512bb3f21dacaf7c6ea6c39d1a75c0368e8f4864a538bfcb9756a006a322f1bb" Sep 19 01:39:50.509902 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.509862 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:50.510154 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.509878 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:50.510154 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:50.509976 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:50.510154 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:50.510084 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:50.662202 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.662177 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:39:50.662584 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.662546 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" event={"ID":"480be173-55c0-467c-a043-ced8a09f95d8","Type":"ContainerStarted","Data":"552c4eeb384993b9c14655438467c9eb9573aa0fde871ad93fe2e8518bc4fee8"} Sep 19 01:39:50.662741 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.662723 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:50.662817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.662772 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:50.662817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.662815 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:50.664716 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.664693 2587 generic.go:356] "Generic (PLEG): container finished" podID="89e8356f-a36e-4dbd-85ab-f903e3fc245b" containerID="8d4d18586332deef83f04ee31d9f3aa91febeda047495c838a47faae89dab482" exitCode=0 Sep 19 01:39:50.664861 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.664729 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerDied","Data":"8d4d18586332deef83f04ee31d9f3aa91febeda047495c838a47faae89dab482"} Sep 19 01:39:50.679331 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.679312 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:50.679768 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.679748 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:39:50.691557 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.691523 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" podStartSLOduration=10.933059241 podStartE2EDuration="28.691512402s" totalImagesPullingTime="17.758453161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:50.69123317 +0000 UTC m=+30.423971422" watchObservedRunningTime="2026-09-19 01:39:50.691512402 +0000 UTC m=+30.424250655" Sep 19 01:39:50.848721 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.848485 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:50.917678 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:50.917639 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:51.418153 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.418124 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49pw7"] Sep 19 01:39:51.418308 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.418250 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:51.418383 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:51.418362 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:51.421524 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.421496 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrbdw"] Sep 19 01:39:51.421687 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.421612 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:51.421757 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:51.421694 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:51.422077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.422050 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dxcb4"] Sep 19 01:39:51.422190 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.422142 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:51.422278 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:51.422261 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:51.652376 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.652342 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:51.753501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:51.753471 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:52.511299 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:52.511267 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:52.511412 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:52.511360 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:52.511483 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:52.511459 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:52.511600 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:52.511557 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:52.671265 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:52.671190 2587 generic.go:356] "Generic (PLEG): container finished" podID="89e8356f-a36e-4dbd-85ab-f903e3fc245b" containerID="a06487c6a99e9d9b9e71e3058f3b3aaa1fa18d5529ea12d5e763e38623fd796a" exitCode=0 Sep 19 01:39:52.671681 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:52.671258 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerDied","Data":"a06487c6a99e9d9b9e71e3058f3b3aaa1fa18d5529ea12d5e763e38623fd796a"} Sep 19 01:39:53.509661 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:53.509631 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:53.509787 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:53.509731 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:54.509614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:54.509583 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:54.509614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:54.509603 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:54.510110 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:54.509709 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49pw7" podUID="a7f09212-56af-47d0-b7eb-cfefcbb0d916" Sep 19 01:39:54.510110 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:54.509822 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxcb4" podUID="08b545de-27d7-46fa-9195-3782f8cd7f21" Sep 19 01:39:54.677606 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:54.677550 2587 generic.go:356] "Generic (PLEG): container finished" podID="89e8356f-a36e-4dbd-85ab-f903e3fc245b" containerID="77a141d90972ca13bad523e82253f3bd63937fe1242bfb4977c8739e4f32dcfe" exitCode=0 Sep 19 01:39:54.677747 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:54.677636 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerDied","Data":"77a141d90972ca13bad523e82253f3bd63937fe1242bfb4977c8739e4f32dcfe"} Sep 19 01:39:55.509817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:55.509787 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:55.510240 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:55.509900 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrbdw" podUID="e1d86922-3f83-461c-aa42-80912ea228f3" Sep 19 01:39:56.232816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.232601 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:56.232980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.232836 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:56.232980 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.232772 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:56.232980 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.232954 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:56.233149 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.232954 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret podName:a7f09212-56af-47d0-b7eb-cfefcbb0d916 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.232933827 +0000 UTC m=+67.965672072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret") pod "global-pull-secret-syncer-49pw7" (UID: "a7f09212-56af-47d0-b7eb-cfefcbb0d916") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:56.233149 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.233008 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.232991175 +0000 UTC m=+67.965729411 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:56.324680 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.324598 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeReady" Sep 19 01:39:56.324860 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.324754 2587 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 19 01:39:56.333356 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.333328 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:56.333496 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.333480 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:56.333549 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.333504 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:56.333549 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.333519 2587 projected.go:196] Error preparing data for projected volume kube-api-access-wn277 for pod openshift-network-diagnostics/network-check-target-wrbdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:56.333643 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.333579 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277 podName:e1d86922-3f83-461c-aa42-80912ea228f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.333550342 +0000 UTC m=+68.066288573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn277" (UniqueName: "kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277") pod "network-check-target-wrbdw" (UID: "e1d86922-3f83-461c-aa42-80912ea228f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:56.375183 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.375161 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x5lhn"] Sep 19 01:39:56.393146 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.392313 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sbfrx"] Sep 19 01:39:56.393146 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.392460 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.395273 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.395031 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 19 01:39:56.395273 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.395142 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 19 01:39:56.395609 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.395585 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttj8c\"" Sep 19 01:39:56.410551 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.410533 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x5lhn"] Sep 19 01:39:56.410666 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.410584 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbfrx"] Sep 19 01:39:56.410666 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.410653 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:56.413540 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.413473 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-898pj\"" Sep 19 01:39:56.413540 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.413490 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 19 01:39:56.413753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.413540 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 19 01:39:56.413753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.413505 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 19 01:39:56.509988 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.509961 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:39:56.510425 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.510091 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:39:56.510772 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.510740 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:56.513422 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.513401 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 01:39:56.513772 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.513632 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 01:39:56.513772 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.513696 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mflb\"" Sep 19 01:39:56.534278 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.534259 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.534377 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.534283 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb4ddc3-53d0-4609-93d8-921c8355736c-tmp-dir\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.534377 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.534327 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30d4b3b9-0f41-498a-b012-6c68895e93c4-cert\") pod \"ingress-canary-sbfrx\" (UID: \"30d4b3b9-0f41-498a-b012-6c68895e93c4\") " pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:56.534493 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.534415 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfb4ddc3-53d0-4609-93d8-921c8355736c-config-volume\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.534493 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.534439 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt2df\" (UniqueName: \"kubernetes.io/projected/cfb4ddc3-53d0-4609-93d8-921c8355736c-kube-api-access-gt2df\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.534493 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.534466 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb88l\" (UniqueName: \"kubernetes.io/projected/30d4b3b9-0f41-498a-b012-6c68895e93c4-kube-api-access-pb88l\") pod \"ingress-canary-sbfrx\" (UID: \"30d4b3b9-0f41-498a-b012-6c68895e93c4\") " pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:56.605872 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.605810 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:56.634870 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.634842 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30d4b3b9-0f41-498a-b012-6c68895e93c4-cert\") pod \"ingress-canary-sbfrx\" (UID: \"30d4b3b9-0f41-498a-b012-6c68895e93c4\") " pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:56.635003 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.634920 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfb4ddc3-53d0-4609-93d8-921c8355736c-config-volume\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.635003 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.634948 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt2df\" (UniqueName: \"kubernetes.io/projected/cfb4ddc3-53d0-4609-93d8-921c8355736c-kube-api-access-gt2df\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.635003 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.634978 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb88l\" (UniqueName: \"kubernetes.io/projected/30d4b3b9-0f41-498a-b012-6c68895e93c4-kube-api-access-pb88l\") pod \"ingress-canary-sbfrx\" (UID: \"30d4b3b9-0f41-498a-b012-6c68895e93c4\") " pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:56.635206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.635185 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.635269 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.635214 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb4ddc3-53d0-4609-93d8-921c8355736c-tmp-dir\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.635393 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.635376 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:56.635456 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:56.635448 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls podName:cfb4ddc3-53d0-4609-93d8-921c8355736c nodeName:}" failed. No retries permitted until 2026-09-19 01:39:57.13543062 +0000 UTC m=+36.868168854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls") pod "dns-default-x5lhn" (UID: "cfb4ddc3-53d0-4609-93d8-921c8355736c") : secret "dns-default-metrics-tls" not found Sep 19 01:39:56.635517 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.635478 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb4ddc3-53d0-4609-93d8-921c8355736c-tmp-dir\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.635720 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.635701 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfb4ddc3-53d0-4609-93d8-921c8355736c-config-volume\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.639612 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.639594 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30d4b3b9-0f41-498a-b012-6c68895e93c4-cert\") pod \"ingress-canary-sbfrx\" (UID: \"30d4b3b9-0f41-498a-b012-6c68895e93c4\") " pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:56.644596 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.644557 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt2df\" (UniqueName: \"kubernetes.io/projected/cfb4ddc3-53d0-4609-93d8-921c8355736c-kube-api-access-gt2df\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:56.644696 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.644593 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb88l\" (UniqueName: \"kubernetes.io/projected/30d4b3b9-0f41-498a-b012-6c68895e93c4-kube-api-access-pb88l\") pod \"ingress-canary-sbfrx\" (UID: \"30d4b3b9-0f41-498a-b012-6c68895e93c4\") " pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:56.719635 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:56.719608 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbfrx" Sep 19 01:39:57.039745 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:57.039714 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbfrx"] Sep 19 01:39:57.044996 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:39:57.044964 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d4b3b9_0f41_498a_b012_6c68895e93c4.slice/crio-0dbdb40e98a047341eaa7405561560c37addabf72e6665ab8c316cdc0ba9024e WatchSource:0}: Error finding container 0dbdb40e98a047341eaa7405561560c37addabf72e6665ab8c316cdc0ba9024e: Status 404 returned error can't find the container with id 0dbdb40e98a047341eaa7405561560c37addabf72e6665ab8c316cdc0ba9024e Sep 19 01:39:57.139439 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:57.139402 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:57.139600 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:57.139578 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:57.139677 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:57.139666 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls podName:cfb4ddc3-53d0-4609-93d8-921c8355736c nodeName:}" failed. No retries permitted until 2026-09-19 01:39:58.139645021 +0000 UTC m=+37.872383267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls") pod "dns-default-x5lhn" (UID: "cfb4ddc3-53d0-4609-93d8-921c8355736c") : secret "dns-default-metrics-tls" not found Sep 19 01:39:57.509876 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:57.509848 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:39:57.512826 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:57.512805 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 01:39:57.513595 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:57.512809 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 01:39:57.513595 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:57.512856 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-td9x9\"" Sep 19 01:39:57.687225 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:57.687189 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbfrx" event={"ID":"30d4b3b9-0f41-498a-b012-6c68895e93c4","Type":"ContainerStarted","Data":"0dbdb40e98a047341eaa7405561560c37addabf72e6665ab8c316cdc0ba9024e"} Sep 19 01:39:58.146257 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:58.146219 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:39:58.146455 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:58.146358 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:58.146455 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:39:58.146435 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls podName:cfb4ddc3-53d0-4609-93d8-921c8355736c nodeName:}" failed. No retries permitted until 2026-09-19 01:40:00.14641207 +0000 UTC m=+39.879150301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls") pod "dns-default-x5lhn" (UID: "cfb4ddc3-53d0-4609-93d8-921c8355736c") : secret "dns-default-metrics-tls" not found Sep 19 01:39:59.695324 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:59.695122 2587 generic.go:356] "Generic (PLEG): container finished" podID="89e8356f-a36e-4dbd-85ab-f903e3fc245b" containerID="fb4f54d329f3686134b9baf4c30c7b565849b8950c2e65e6fac7ac4a3dec436b" exitCode=0 Sep 19 01:39:59.695744 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:39:59.695206 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerDied","Data":"fb4f54d329f3686134b9baf4c30c7b565849b8950c2e65e6fac7ac4a3dec436b"} Sep 19 01:40:00.159976 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:00.159868 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:40:00.160135 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:00.159995 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:40:00.160135 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:00.160051 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls podName:cfb4ddc3-53d0-4609-93d8-921c8355736c nodeName:}" failed. No retries permitted until 2026-09-19 01:40:04.160036511 +0000 UTC m=+43.892774741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls") pod "dns-default-x5lhn" (UID: "cfb4ddc3-53d0-4609-93d8-921c8355736c") : secret "dns-default-metrics-tls" not found Sep 19 01:40:00.584085 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:00.584035 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:00.685600 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:00.685529 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:00.701324 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:00.701294 2587 generic.go:356] "Generic (PLEG): container finished" podID="89e8356f-a36e-4dbd-85ab-f903e3fc245b" containerID="e0c7bb08de6a651cdd84982a2d7d3073df4a34da8db56398c31b38c20c369177" exitCode=0 Sep 19 01:40:00.701676 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:00.701357 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerDied","Data":"e0c7bb08de6a651cdd84982a2d7d3073df4a34da8db56398c31b38c20c369177"} Sep 19 01:40:01.706483 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:01.706445 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" event={"ID":"89e8356f-a36e-4dbd-85ab-f903e3fc245b","Type":"ContainerStarted","Data":"370a9855115b7f393b610affc6d943d52071f36e9bc95859d6dcd8fc0dde0c04"} Sep 19 01:40:01.707871 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:01.707851 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbfrx" event={"ID":"30d4b3b9-0f41-498a-b012-6c68895e93c4","Type":"ContainerStarted","Data":"a343e78832e15cb2d86a91fecd04d74c643e1feb29496a861c9406adfa966cd0"} Sep 19 01:40:01.732585 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:01.732535 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jkmc8" podStartSLOduration=10.994503334000001 podStartE2EDuration="39.732521212s" totalImagesPullingTime="28.738017878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:01.730445215 +0000 UTC m=+41.463183469" watchObservedRunningTime="2026-09-19 01:40:01.732521212 +0000 UTC m=+41.465259466" Sep 19 01:40:01.749715 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:01.749680 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sbfrx" podStartSLOduration=2.05988033 podStartE2EDuration="5.749667593s" totalImagesPullingTime="3.689787263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:01.749105999 +0000 UTC m=+41.481844256" watchObservedRunningTime="2026-09-19 01:40:01.749667593 +0000 UTC m=+41.482405855" Sep 19 01:40:01.874695 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:01.874669 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:01.943038 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:01.943013 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:04.186587 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:04.186526 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:40:04.187008 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:04.186674 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:40:04.187008 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:04.186739 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls podName:cfb4ddc3-53d0-4609-93d8-921c8355736c nodeName:}" failed. No retries permitted until 2026-09-19 01:40:12.186722566 +0000 UTC m=+51.919460819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls") pod "dns-default-x5lhn" (UID: "cfb4ddc3-53d0-4609-93d8-921c8355736c") : secret "dns-default-metrics-tls" not found Sep 19 01:40:06.787950 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:06.787910 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:06.852253 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:06.852222 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:12.243491 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:12.243460 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:40:12.243886 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:12.243580 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:40:12.243886 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:12.243644 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls podName:cfb4ddc3-53d0-4609-93d8-921c8355736c nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.243630116 +0000 UTC m=+67.976368360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls") pod "dns-default-x5lhn" (UID: "cfb4ddc3-53d0-4609-93d8-921c8355736c") : secret "dns-default-metrics-tls" not found Sep 19 01:40:12.854537 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:12.854501 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:12.913968 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:12.913932 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:15.405268 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.405238 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7"] Sep 19 01:40:15.439186 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.439160 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7"] Sep 19 01:40:15.439311 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.439245 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.442238 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.442214 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.442390 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.442326 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 19 01:40:15.442390 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.442326 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.442488 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.442329 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 19 01:40:15.443475 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.443456 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h6qxv\"" Sep 19 01:40:15.502560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.502536 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg"] Sep 19 01:40:15.520950 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.520933 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9"] Sep 19 01:40:15.521054 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.521042 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" Sep 19 01:40:15.524074 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.524056 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.524074 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.524064 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.524196 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.524062 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qxzg2\"" Sep 19 01:40:15.540862 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.540845 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-685cd8b794-rd4s4"] Sep 19 01:40:15.541333 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.541287 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.546336 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.546302 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 19 01:40:15.546336 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.546317 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cg2bn\"" Sep 19 01:40:15.546497 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.546402 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 19 01:40:15.546497 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.546418 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.546497 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.546445 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.566736 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.566709 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/167c0574-1417-4fa3-9c0d-fb4470996fc9-serving-cert\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.566943 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.566918 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9tpz\" (UniqueName: \"kubernetes.io/projected/167c0574-1417-4fa3-9c0d-fb4470996fc9-kube-api-access-h9tpz\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.567032 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.566966 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/167c0574-1417-4fa3-9c0d-fb4470996fc9-config\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.567032 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.566982 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg"] Sep 19 01:40:15.567032 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.567007 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-685cd8b794-rd4s4"] Sep 19 01:40:15.567032 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.567019 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9"] Sep 19 01:40:15.567176 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.567088 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.569942 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.569926 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.570037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.569996 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.570037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.570017 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-clzxf\"" Sep 19 01:40:15.570037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.570029 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 19 01:40:15.570198 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.570141 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 19 01:40:15.570198 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.570163 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 19 01:40:15.570284 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.570174 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 19 01:40:15.602786 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.602764 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc"] Sep 19 01:40:15.621026 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.621001 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" Sep 19 01:40:15.622200 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.622182 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc"] Sep 19 01:40:15.624438 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.624420 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-62sj5\"" Sep 19 01:40:15.667530 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667479 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4tm7\" (UniqueName: \"kubernetes.io/projected/a607f451-c9cc-48e3-9820-38befc8ae26b-kube-api-access-b4tm7\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.667530 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667505 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.667530 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667521 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/560ad04e-389c-4f1b-8b47-0a93e69b04d8-kube-api-access-s5d4l\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.667692 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667543 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/167c0574-1417-4fa3-9c0d-fb4470996fc9-config\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.667692 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667600 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a607f451-c9cc-48e3-9820-38befc8ae26b-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.667759 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667706 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.667792 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667770 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/167c0574-1417-4fa3-9c0d-fb4470996fc9-serving-cert\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.667825 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667808 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb7tf\" (UniqueName: \"kubernetes.io/projected/e561de6a-b58a-4ee5-8fd1-60715cc0977d-kube-api-access-rb7tf\") pod \"volume-data-source-validator-5c4db8bdf9-j8dmg\" (UID: \"e561de6a-b58a-4ee5-8fd1-60715cc0977d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" Sep 19 01:40:15.667863 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667825 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-default-certificate\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.667863 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667854 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9tpz\" (UniqueName: \"kubernetes.io/projected/167c0574-1417-4fa3-9c0d-fb4470996fc9-kube-api-access-h9tpz\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.667937 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667868 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.667937 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.667888 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-stats-auth\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.668148 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.668127 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/167c0574-1417-4fa3-9c0d-fb4470996fc9-config\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.670622 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.670607 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/167c0574-1417-4fa3-9c0d-fb4470996fc9-serving-cert\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.676645 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.676625 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9tpz\" (UniqueName: \"kubernetes.io/projected/167c0574-1417-4fa3-9c0d-fb4470996fc9-kube-api-access-h9tpz\") pod \"service-ca-operator-57cdc4b768-qkhs7\" (UID: \"167c0574-1417-4fa3-9c0d-fb4470996fc9\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.743471 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.743444 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:15.748350 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.748335 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" Sep 19 01:40:15.768668 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768648 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.768778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768677 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-stats-auth\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.768778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768713 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4tm7\" (UniqueName: \"kubernetes.io/projected/a607f451-c9cc-48e3-9820-38befc8ae26b-kube-api-access-b4tm7\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.768778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768742 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.768778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768767 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/560ad04e-389c-4f1b-8b47-0a93e69b04d8-kube-api-access-s5d4l\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.768979 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768795 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a607f451-c9cc-48e3-9820-38befc8ae26b-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.768979 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:15.768814 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:16.268795503 +0000 UTC m=+56.001533735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : configmap references non-existent config key: service-ca.crt Sep 19 01:40:15.768979 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768852 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqv9m\" (UniqueName: \"kubernetes.io/projected/37d31d04-453a-42ef-9469-5987534464ea-kube-api-access-tqv9m\") pod \"network-check-source-7cbc45fddc-wvbjc\" (UID: \"37d31d04-453a-42ef-9469-5987534464ea\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" Sep 19 01:40:15.768979 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.768889 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.768979 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:15.768897 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:15.768979 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:15.768953 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls podName:a607f451-c9cc-48e3-9820-38befc8ae26b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:16.268940461 +0000 UTC m=+56.001678692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-h9ks9" (UID: "a607f451-c9cc-48e3-9820-38befc8ae26b") : secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:15.769314 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.769015 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb7tf\" (UniqueName: \"kubernetes.io/projected/e561de6a-b58a-4ee5-8fd1-60715cc0977d-kube-api-access-rb7tf\") pod \"volume-data-source-validator-5c4db8bdf9-j8dmg\" (UID: \"e561de6a-b58a-4ee5-8fd1-60715cc0977d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" Sep 19 01:40:15.769314 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.769042 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-default-certificate\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.769314 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:15.769123 2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 01:40:15.769314 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:15.769187 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:16.269170097 +0000 UTC m=+56.001908336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : secret "router-metrics-certs-default" not found Sep 19 01:40:15.769829 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.769807 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a607f451-c9cc-48e3-9820-38befc8ae26b-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.773039 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.771840 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-default-certificate\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.773039 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.772956 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-stats-auth\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.778304 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.778278 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4tm7\" (UniqueName: \"kubernetes.io/projected/a607f451-c9cc-48e3-9820-38befc8ae26b-kube-api-access-b4tm7\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:15.778304 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.778290 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb7tf\" (UniqueName: \"kubernetes.io/projected/e561de6a-b58a-4ee5-8fd1-60715cc0977d-kube-api-access-rb7tf\") pod \"volume-data-source-validator-5c4db8bdf9-j8dmg\" (UID: \"e561de6a-b58a-4ee5-8fd1-60715cc0977d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" Sep 19 01:40:15.778669 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.778651 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/560ad04e-389c-4f1b-8b47-0a93e69b04d8-kube-api-access-s5d4l\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:15.831213 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.831188 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" Sep 19 01:40:15.844094 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.844064 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:15.870095 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.870076 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqv9m\" (UniqueName: \"kubernetes.io/projected/37d31d04-453a-42ef-9469-5987534464ea-kube-api-access-tqv9m\") pod \"network-check-source-7cbc45fddc-wvbjc\" (UID: \"37d31d04-453a-42ef-9469-5987534464ea\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" Sep 19 01:40:15.878581 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.878546 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqv9m\" (UniqueName: \"kubernetes.io/projected/37d31d04-453a-42ef-9469-5987534464ea-kube-api-access-tqv9m\") pod \"network-check-source-7cbc45fddc-wvbjc\" (UID: \"37d31d04-453a-42ef-9469-5987534464ea\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" Sep 19 01:40:15.929895 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:15.929845 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" Sep 19 01:40:16.032216 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.032175 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7"] Sep 19 01:40:16.034593 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:16.034548 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167c0574_1417_4fa3_9c0d_fb4470996fc9.slice/crio-538bd96ecaabb3bd727402bad10997618edfb5acb9c089b92f6f408cf9c87e70 WatchSource:0}: Error finding container 538bd96ecaabb3bd727402bad10997618edfb5acb9c089b92f6f408cf9c87e70: Status 404 returned error can't find the container with id 538bd96ecaabb3bd727402bad10997618edfb5acb9c089b92f6f408cf9c87e70 Sep 19 01:40:16.132095 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.132071 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg"] Sep 19 01:40:16.134442 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:16.134421 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode561de6a_b58a_4ee5_8fd1_60715cc0977d.slice/crio-61b430b7642276581a14d3c81e683f3c415a76feb3b3b9fab360abdaffc353ef WatchSource:0}: Error finding container 61b430b7642276581a14d3c81e683f3c415a76feb3b3b9fab360abdaffc353ef: Status 404 returned error can't find the container with id 61b430b7642276581a14d3c81e683f3c415a76feb3b3b9fab360abdaffc353ef Sep 19 01:40:16.214644 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.214624 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc"] Sep 19 01:40:16.216741 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:16.216719 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d31d04_453a_42ef_9469_5987534464ea.slice/crio-b57eaa95aaec72492c687d9b27bd3cbce9376b010aba5a55c08e05157a88dbbc WatchSource:0}: Error finding container b57eaa95aaec72492c687d9b27bd3cbce9376b010aba5a55c08e05157a88dbbc: Status 404 returned error can't find the container with id b57eaa95aaec72492c687d9b27bd3cbce9376b010aba5a55c08e05157a88dbbc Sep 19 01:40:16.273090 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.273065 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:16.273177 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.273097 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:16.273177 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.273121 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:16.273292 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:16.273216 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:16.273292 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:16.273233 2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 01:40:16.273292 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:16.273245 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:17.27322351 +0000 UTC m=+57.005961756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : configmap references non-existent config key: service-ca.crt Sep 19 01:40:16.273292 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:16.273271 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:17.273258933 +0000 UTC m=+57.005997164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : secret "router-metrics-certs-default" not found Sep 19 01:40:16.273292 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:16.273287 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls podName:a607f451-c9cc-48e3-9820-38befc8ae26b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:17.273278334 +0000 UTC m=+57.006016772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-h9ks9" (UID: "a607f451-c9cc-48e3-9820-38befc8ae26b") : secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:16.743333 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.743262 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" event={"ID":"e561de6a-b58a-4ee5-8fd1-60715cc0977d","Type":"ContainerStarted","Data":"61b430b7642276581a14d3c81e683f3c415a76feb3b3b9fab360abdaffc353ef"} Sep 19 01:40:16.745030 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.744996 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" event={"ID":"167c0574-1417-4fa3-9c0d-fb4470996fc9","Type":"ContainerStarted","Data":"538bd96ecaabb3bd727402bad10997618edfb5acb9c089b92f6f408cf9c87e70"} Sep 19 01:40:16.746531 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:16.746494 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" event={"ID":"37d31d04-453a-42ef-9469-5987534464ea","Type":"ContainerStarted","Data":"b57eaa95aaec72492c687d9b27bd3cbce9376b010aba5a55c08e05157a88dbbc"} Sep 19 01:40:17.283030 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:17.282994 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:17.283214 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:17.283049 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:17.283214 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:17.283089 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:17.283312 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:17.283224 2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 01:40:17.283312 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:17.283288 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:19.28326831 +0000 UTC m=+59.016006543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : secret "router-metrics-certs-default" not found Sep 19 01:40:17.283757 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:17.283723 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:19.283705928 +0000 UTC m=+59.016444174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : configmap references non-existent config key: service-ca.crt Sep 19 01:40:17.283911 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:17.283859 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:17.283973 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:17.283919 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls podName:a607f451-c9cc-48e3-9820-38befc8ae26b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:19.283905165 +0000 UTC m=+59.016643415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-h9ks9" (UID: "a607f451-c9cc-48e3-9820-38befc8ae26b") : secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:18.754782 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:18.754739 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" event={"ID":"e561de6a-b58a-4ee5-8fd1-60715cc0977d","Type":"ContainerStarted","Data":"d6930cb94c06ffd6cac9f3f7a9c86dc16c8af3faf36b491196b5d70b74a9150e"} Sep 19 01:40:18.771011 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:18.770969 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-j8dmg" podStartSLOduration=1.984584887 podStartE2EDuration="3.770950572s" totalImagesPullingTime="1.786365685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:18.770143824 +0000 UTC m=+58.502882092" watchObservedRunningTime="2026-09-19 01:40:18.770950572 +0000 UTC m=+58.503688827" Sep 19 01:40:18.849152 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:18.849103 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:18.915050 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:18.915023 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:19.302864 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:19.302834 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:19.303069 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:19.302881 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:19.303069 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:19.302920 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:19.303069 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:19.303023 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:23.303000155 +0000 UTC m=+63.035738387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : configmap references non-existent config key: service-ca.crt Sep 19 01:40:19.303236 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:19.303080 2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 01:40:19.303236 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:19.303083 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:19.303236 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:19.303127 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:23.303115435 +0000 UTC m=+63.035853667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : secret "router-metrics-certs-default" not found Sep 19 01:40:19.303236 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:19.303149 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls podName:a607f451-c9cc-48e3-9820-38befc8ae26b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:23.303132803 +0000 UTC m=+63.035871061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-h9ks9" (UID: "a607f451-c9cc-48e3-9820-38befc8ae26b") : secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:20.068075 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.068048 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:20.084126 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.084101 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z"] Sep 19 01:40:20.106053 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.106018 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z"] Sep 19 01:40:20.106210 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.106161 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" Sep 19 01:40:20.107302 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.107256 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zhs\" (UniqueName: \"kubernetes.io/projected/c5644aba-5eb2-48d1-8e56-3dda8a12e0c4-kube-api-access-q6zhs\") pod \"migrator-76794cbd6c-prx2z\" (UID: \"c5644aba-5eb2-48d1-8e56-3dda8a12e0c4\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" Sep 19 01:40:20.109019 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.108996 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 19 01:40:20.109145 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.108997 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 19 01:40:20.110203 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.110183 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qsb7h\"" Sep 19 01:40:20.159632 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.159601 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:20.207896 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.207869 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zhs\" (UniqueName: \"kubernetes.io/projected/c5644aba-5eb2-48d1-8e56-3dda8a12e0c4-kube-api-access-q6zhs\") pod \"migrator-76794cbd6c-prx2z\" (UID: \"c5644aba-5eb2-48d1-8e56-3dda8a12e0c4\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" Sep 19 01:40:20.216252 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.216232 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zhs\" (UniqueName: \"kubernetes.io/projected/c5644aba-5eb2-48d1-8e56-3dda8a12e0c4-kube-api-access-q6zhs\") pod \"migrator-76794cbd6c-prx2z\" (UID: \"c5644aba-5eb2-48d1-8e56-3dda8a12e0c4\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" Sep 19 01:40:20.260583 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.260543 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:20.415801 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.415765 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" Sep 19 01:40:20.700947 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.700916 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z"] Sep 19 01:40:20.703865 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:20.703838 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5644aba_5eb2_48d1_8e56_3dda8a12e0c4.slice/crio-da1514d775671f297918020b926655699710007b5241b8907cec9e3a2fe304c1 WatchSource:0}: Error finding container da1514d775671f297918020b926655699710007b5241b8907cec9e3a2fe304c1: Status 404 returned error can't find the container with id da1514d775671f297918020b926655699710007b5241b8907cec9e3a2fe304c1 Sep 19 01:40:20.762267 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.762193 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" event={"ID":"167c0574-1417-4fa3-9c0d-fb4470996fc9","Type":"ContainerStarted","Data":"edfe5b3e2ee34ebad6ff8cf8fcb4376acc6e44ae9f5cd113e084e8673c8e0cb9"} Sep 19 01:40:20.763516 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.763487 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" event={"ID":"c5644aba-5eb2-48d1-8e56-3dda8a12e0c4","Type":"ContainerStarted","Data":"da1514d775671f297918020b926655699710007b5241b8907cec9e3a2fe304c1"} Sep 19 01:40:20.765083 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.765058 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" event={"ID":"37d31d04-453a-42ef-9469-5987534464ea","Type":"ContainerStarted","Data":"a60a7d4ffced641d6e0b5363ebb9b450f5332fbe8c560606695bd0a5a7352279"} Sep 19 01:40:20.781635 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.781559 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" podStartSLOduration=1.855741916 podStartE2EDuration="5.781540342s" totalImagesPullingTime="3.925798426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:20.780894866 +0000 UTC m=+60.513633118" watchObservedRunningTime="2026-09-19 01:40:20.781540342 +0000 UTC m=+60.514278599" Sep 19 01:40:20.799809 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.799770 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-wvbjc" podStartSLOduration=2.046841037 podStartE2EDuration="5.799757479s" totalImagesPullingTime="3.752916442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:20.799020271 +0000 UTC m=+60.531758526" watchObservedRunningTime="2026-09-19 01:40:20.799757479 +0000 UTC m=+60.532495729" Sep 19 01:40:20.949892 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.949858 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jhg94"] Sep 19 01:40:20.951370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.951330 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:20.984778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.984742 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhg94"] Sep 19 01:40:20.984899 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.984865 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:20.987759 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.987730 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 19 01:40:20.987904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.987757 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 19 01:40:20.987904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.987835 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 19 01:40:20.988085 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.988069 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vg5n6\"" Sep 19 01:40:20.988146 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:20.988130 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 19 01:40:21.014092 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.014019 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b2708af3-3132-4ca6-9568-68ddc2f7220b-crio-socket\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.014092 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.014050 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2708af3-3132-4ca6-9568-68ddc2f7220b-data-volume\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.014340 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.014138 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.014340 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.014264 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lgcb\" (UniqueName: \"kubernetes.io/projected/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-api-access-4lgcb\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.014340 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.014298 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.014340 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.014333 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:21.115176 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.115146 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.115259 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lgcb\" (UniqueName: \"kubernetes.io/projected/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-api-access-4lgcb\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.115289 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.115293 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.115362 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:21.615341408 +0000 UTC m=+61.348079654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : configmap "kube-rbac-proxy" not found Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.115382 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.115440 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:21.615425577 +0000 UTC m=+61.348163821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.115457 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b2708af3-3132-4ca6-9568-68ddc2f7220b-crio-socket\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.115483 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2708af3-3132-4ca6-9568-68ddc2f7220b-data-volume\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.115579 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.115537 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b2708af3-3132-4ca6-9568-68ddc2f7220b-crio-socket\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.115879 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.115811 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2708af3-3132-4ca6-9568-68ddc2f7220b-data-volume\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.128044 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.128021 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lgcb\" (UniqueName: \"kubernetes.io/projected/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-api-access-4lgcb\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.620287 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.620255 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.620442 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:21.620332 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:21.620442 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.620413 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:21.620442 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.620433 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.620544 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.620501 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:22.620485634 +0000 UTC m=+62.353223865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.620544 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:21.620515 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:22.620509673 +0000 UTC m=+62.353247904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : configmap "kube-rbac-proxy" not found Sep 19 01:40:22.563453 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.563419 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:22.629237 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.629208 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:22.629367 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.629275 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:22.629367 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:22.629321 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:22.629367 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:22.629363 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:22.629477 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:22.629375 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:24.629359026 +0000 UTC m=+64.362097257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : configmap "kube-rbac-proxy" not found Sep 19 01:40:22.629477 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:22.629403 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:24.629391593 +0000 UTC m=+64.362129823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:22.682328 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.682306 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gp6l" Sep 19 01:40:22.685892 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.685873 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:22.771961 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.771934 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" event={"ID":"c5644aba-5eb2-48d1-8e56-3dda8a12e0c4","Type":"ContainerStarted","Data":"717034ce6ed78cbdf3b8ba6817fa08cceacca2406f72f8b13ffd0a98014a351f"} Sep 19 01:40:22.772086 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.771980 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" event={"ID":"c5644aba-5eb2-48d1-8e56-3dda8a12e0c4","Type":"ContainerStarted","Data":"bbc4d7cd5810c5efb386a9d9e49f4b095313cf0b5a4fa4db9c21c81b2b5d6a1d"} Sep 19 01:40:22.808981 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.808939 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-prx2z" podStartSLOduration=1.6471256539999999 podStartE2EDuration="2.808926877s" totalImagesPullingTime="1.161801223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:22.808778762 +0000 UTC m=+62.541517016" watchObservedRunningTime="2026-09-19 01:40:22.808926877 +0000 UTC m=+62.541665129" Sep 19 01:40:22.849483 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.849429 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:22.941224 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:22.941201 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:23.041202 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:23.041177 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:23.333306 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:23.333274 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:23.333460 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:23.333383 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:23.333460 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:23.333408 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:23.333460 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:23.333413 2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 01:40:23.333602 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:23.333470 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:31.333454802 +0000 UTC m=+71.066193033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : secret "router-metrics-certs-default" not found Sep 19 01:40:23.333602 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:23.333499 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:23.333602 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:23.333532 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:31.333516945 +0000 UTC m=+71.066255200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : configmap references non-existent config key: service-ca.crt Sep 19 01:40:23.333602 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:23.333554 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls podName:a607f451-c9cc-48e3-9820-38befc8ae26b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:31.333544276 +0000 UTC m=+71.066282507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-h9ks9" (UID: "a607f451-c9cc-48e3-9820-38befc8ae26b") : secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:23.364262 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:23.364240 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:23.467880 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:23.467850 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:23.699035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:23.699009 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dvqqh_4934e60f-3b69-4fe2-b79a-1df00778d41e/dns-node-resolver/0.log" Sep 19 01:40:24.645287 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.645254 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:24.645462 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.645349 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:24.645462 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:24.645402 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:24.645532 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:24.645466 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.645451639 +0000 UTC m=+68.378189869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:24.645532 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:24.645489 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:24.645625 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:24.645550 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.645535885 +0000 UTC m=+68.378274136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : configmap "kube-rbac-proxy" not found Sep 19 01:40:24.848294 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.848263 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-kkkgj"] Sep 19 01:40:24.851212 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.851193 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:24.854242 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.854215 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 19 01:40:24.854503 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.854485 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v2vsb\"" Sep 19 01:40:24.855654 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.855636 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 19 01:40:24.855746 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.855678 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 19 01:40:24.855831 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.855809 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 19 01:40:24.859228 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.859211 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-kkkgj"] Sep 19 01:40:24.902475 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.902416 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-npmxp_6d451716-6490-4ed9-9ad9-0cce3ad39280/node-ca/0.log" Sep 19 01:40:24.947974 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.947951 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/663a4637-e3a4-49b9-bd0e-69776a65ddb7-signing-cabundle\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:24.948073 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.947988 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58n8q\" (UniqueName: \"kubernetes.io/projected/663a4637-e3a4-49b9-bd0e-69776a65ddb7-kube-api-access-58n8q\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:24.948169 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.948150 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/663a4637-e3a4-49b9-bd0e-69776a65ddb7-signing-key\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:24.955914 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:24.955893 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:25.049422 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.049400 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58n8q\" (UniqueName: \"kubernetes.io/projected/663a4637-e3a4-49b9-bd0e-69776a65ddb7-kube-api-access-58n8q\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:25.049514 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.049492 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/663a4637-e3a4-49b9-bd0e-69776a65ddb7-signing-key\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:25.049591 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.049543 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/663a4637-e3a4-49b9-bd0e-69776a65ddb7-signing-cabundle\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:25.050113 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.050094 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/663a4637-e3a4-49b9-bd0e-69776a65ddb7-signing-cabundle\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:25.052047 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.052028 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/663a4637-e3a4-49b9-bd0e-69776a65ddb7-signing-key\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:25.064473 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.064451 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:25.066756 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.066738 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58n8q\" (UniqueName: \"kubernetes.io/projected/663a4637-e3a4-49b9-bd0e-69776a65ddb7-kube-api-access-58n8q\") pod \"service-ca-55f6fc7b86-kkkgj\" (UID: \"663a4637-e3a4-49b9-bd0e-69776a65ddb7\") " pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:25.160191 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.160140 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" Sep 19 01:40:25.442308 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.442284 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-kkkgj"] Sep 19 01:40:25.445454 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:25.445430 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663a4637_e3a4_49b9_bd0e_69776a65ddb7.slice/crio-e81553786540c9e2ed65b13d998486a8aae41a401e25ee628c436b60fa9ba534 WatchSource:0}: Error finding container e81553786540c9e2ed65b13d998486a8aae41a401e25ee628c436b60fa9ba534: Status 404 returned error can't find the container with id e81553786540c9e2ed65b13d998486a8aae41a401e25ee628c436b60fa9ba534 Sep 19 01:40:25.701599 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.701507 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbfrx_30d4b3b9-0f41-498a-b012-6c68895e93c4/serve-healthcheck-canary/0.log" Sep 19 01:40:25.784229 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.784195 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" event={"ID":"663a4637-e3a4-49b9-bd0e-69776a65ddb7","Type":"ContainerStarted","Data":"2ea354cc199fcb06d47cca93b085615c5b933a6d0a31ef0aed648cf9ef0266a5"} Sep 19 01:40:25.784385 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.784248 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" event={"ID":"663a4637-e3a4-49b9-bd0e-69776a65ddb7","Type":"ContainerStarted","Data":"e81553786540c9e2ed65b13d998486a8aae41a401e25ee628c436b60fa9ba534"} Sep 19 01:40:25.803539 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.803489 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-kkkgj" podStartSLOduration=1.80347546 podStartE2EDuration="1.80347546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:25.803187655 +0000 UTC m=+65.535925910" watchObservedRunningTime="2026-09-19 01:40:25.80347546 +0000 UTC m=+65.536213712" Sep 19 01:40:25.903415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:25.903391 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-prx2z_c5644aba-5eb2-48d1-8e56-3dda8a12e0c4/migrator/0.log" Sep 19 01:40:26.038886 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:26.038815 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:26.100383 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:26.100362 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-prx2z_c5644aba-5eb2-48d1-8e56-3dda8a12e0c4/graceful-termination/0.log" Sep 19 01:40:27.183210 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:27.183158 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:27.479124 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:27.479078 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:27.607737 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:27.607705 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:27.713021 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:27.712992 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:27.826287 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:27.826186 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:27.971349 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:27.971316 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:28.277463 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.277427 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:40:28.277944 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.277562 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:40:28.277944 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.277640 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:40:28.277944 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.277689 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:40:28.277944 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.277760 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls podName:cfb4ddc3-53d0-4609-93d8-921c8355736c nodeName:}" failed. No retries permitted until 2026-09-19 01:41:00.277744657 +0000 UTC m=+100.010482916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls") pod "dns-default-x5lhn" (UID: "cfb4ddc3-53d0-4609-93d8-921c8355736c") : secret "dns-default-metrics-tls" not found Sep 19 01:40:28.280147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.280127 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 01:40:28.280356 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.280343 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 01:40:28.287789 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.287775 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 19 01:40:28.287879 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.287816 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs podName:08b545de-27d7-46fa-9195-3782f8cd7f21 nodeName:}" failed. No retries permitted until 2026-09-19 01:41:32.287804333 +0000 UTC m=+132.020542570 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs") pod "network-metrics-daemon-dxcb4" (UID: "08b545de-27d7-46fa-9195-3782f8cd7f21") : secret "metrics-daemon-secret" not found Sep 19 01:40:28.290246 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.290231 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7f09212-56af-47d0-b7eb-cfefcbb0d916-original-pull-secret\") pod \"global-pull-secret-syncer-49pw7\" (UID: \"a7f09212-56af-47d0-b7eb-cfefcbb0d916\") " pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:40:28.321205 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.321176 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49pw7" Sep 19 01:40:28.378367 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.378272 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:40:28.382634 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.382550 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn277\" (UniqueName: \"kubernetes.io/projected/e1d86922-3f83-461c-aa42-80912ea228f3-kube-api-access-wn277\") pod \"network-check-target-wrbdw\" (UID: \"e1d86922-3f83-461c-aa42-80912ea228f3\") " pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:40:28.424073 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.424053 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-td9x9\"" Sep 19 01:40:28.431491 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.431474 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:40:28.593297 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.593224 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49pw7"] Sep 19 01:40:28.598056 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:28.598034 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f09212_56af_47d0_b7eb_cfefcbb0d916.slice/crio-a81526050e5cb054c4e1858a20ed3bf472040ffe8e8b6c8a72369320c38afd4d WatchSource:0}: Error finding container a81526050e5cb054c4e1858a20ed3bf472040ffe8e8b6c8a72369320c38afd4d: Status 404 returned error can't find the container with id a81526050e5cb054c4e1858a20ed3bf472040ffe8e8b6c8a72369320c38afd4d Sep 19 01:40:28.680666 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.680635 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:28.680768 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.680706 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:28.680819 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.680787 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:28.680873 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.680838 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:36.680822135 +0000 UTC m=+76.413560387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : configmap "kube-rbac-proxy" not found Sep 19 01:40:28.680933 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.680892 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:28.680981 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:28.680972 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:36.680953574 +0000 UTC m=+76.413691822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:28.701393 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.701371 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrbdw"] Sep 19 01:40:28.703925 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:28.703903 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d86922_3f83_461c_aa42_80912ea228f3.slice/crio-0593de871ff3dd38e748750ef4cc08e15dcbfeb24b39e755b6f899c61d522f6b WatchSource:0}: Error finding container 0593de871ff3dd38e748750ef4cc08e15dcbfeb24b39e755b6f899c61d522f6b: Status 404 returned error can't find the container with id 0593de871ff3dd38e748750ef4cc08e15dcbfeb24b39e755b6f899c61d522f6b Sep 19 01:40:28.795584 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.795534 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrbdw" event={"ID":"e1d86922-3f83-461c-aa42-80912ea228f3","Type":"ContainerStarted","Data":"ad5e3b989b54a8cc7a1c364607a2cc64c94eccca7b4306b0b77931e33c4ec817"} Sep 19 01:40:28.795695 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.795610 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrbdw" event={"ID":"e1d86922-3f83-461c-aa42-80912ea228f3","Type":"ContainerStarted","Data":"0593de871ff3dd38e748750ef4cc08e15dcbfeb24b39e755b6f899c61d522f6b"} Sep 19 01:40:28.795695 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.795632 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:40:28.796754 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.796731 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49pw7" event={"ID":"a7f09212-56af-47d0-b7eb-cfefcbb0d916","Type":"ContainerStarted","Data":"a81526050e5cb054c4e1858a20ed3bf472040ffe8e8b6c8a72369320c38afd4d"} Sep 19 01:40:28.813612 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.813546 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrbdw" podStartSLOduration=66.813530117 podStartE2EDuration="1m6.813530117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:28.812944756 +0000 UTC m=+68.545683009" watchObservedRunningTime="2026-09-19 01:40:28.813530117 +0000 UTC m=+68.546268375" Sep 19 01:40:28.848446 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:28.848393 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:29.280887 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:29.280852 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:29.461889 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:29.461854 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:29.732095 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:29.732062 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:30.106079 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:30.105924 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:30.650476 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:30.650444 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:30.725921 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:30.725878 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:30.852147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:30.852104 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:31.056268 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.056231 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:31.157858 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.157824 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:31.404182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.404088 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:31.404182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.404144 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:31.404404 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.404184 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:31.404404 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:31.404248 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:47.404220806 +0000 UTC m=+87.136959045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : configmap references non-existent config key: service-ca.crt Sep 19 01:40:31.404404 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:31.404304 2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 19 01:40:31.404404 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:31.404312 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:31.404404 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:31.404354 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs podName:560ad04e-389c-4f1b-8b47-0a93e69b04d8 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:47.404338327 +0000 UTC m=+87.137076577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs") pod "router-default-685cd8b794-rd4s4" (UID: "560ad04e-389c-4f1b-8b47-0a93e69b04d8") : secret "router-metrics-certs-default" not found Sep 19 01:40:31.404404 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:31.404371 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls podName:a607f451-c9cc-48e3-9820-38befc8ae26b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:47.404361415 +0000 UTC m=+87.137099651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-h9ks9" (UID: "a607f451-c9cc-48e3-9820-38befc8ae26b") : secret "cluster-monitoring-operator-tls" not found Sep 19 01:40:31.456429 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.456401 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:31.852792 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.852757 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:31.953993 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:31.953951 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:32.066887 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:32.066845 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:32.260932 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:32.260892 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:32.813448 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:32.813360 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49pw7" event={"ID":"a7f09212-56af-47d0-b7eb-cfefcbb0d916","Type":"ContainerStarted","Data":"ba48dbc490d3208ffc5f82182e4102c7741a016d1566bacf6daa3a139dd96d92"} Sep 19 01:40:32.836587 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:32.836514 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-49pw7" podStartSLOduration=66.895822968 podStartE2EDuration="1m10.836499608s" totalImagesPullingTime="3.94067664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:32.83561042 +0000 UTC m=+72.568348675" watchObservedRunningTime="2026-09-19 01:40:32.836499608 +0000 UTC m=+72.569237860" Sep 19 01:40:33.107816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:33.107729 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:33.216484 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:33.216451 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:33.379087 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:33.379014 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:33.480660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:33.480621 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:33.648832 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:33.648762 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:34.271585 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:34.271520 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:34.870345 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:34.870316 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:35.104754 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:35.104717 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:35.457265 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:35.457235 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:35.646614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:35.646561 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:36.057130 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:36.057102 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:36.747095 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:36.747061 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:36.747554 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:36.747150 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:36.747554 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:36.747252 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:36.747554 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:40:36.747312 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls podName:b2708af3-3132-4ca6-9568-68ddc2f7220b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:52.747298324 +0000 UTC m=+92.480036555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhg94" (UID: "b2708af3-3132-4ca6-9568-68ddc2f7220b") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:36.747816 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:36.747795 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2708af3-3132-4ca6-9568-68ddc2f7220b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:36.854886 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:36.854860 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:37.094995 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:37.094919 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:37.448686 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:37.448648 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:37.663975 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:37.663940 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:37.857687 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:37.857621 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:38.186309 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:38.186226 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:39.681447 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:39.681406 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:39.782259 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:39.782194 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:39.883440 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:39.883409 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:39.983355 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:39.983328 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:40.356334 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:40.356260 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:40.415606 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:40.415555 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:40.552437 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:40.552408 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:40.615673 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:40.615616 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:41.165413 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:41.165370 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:41.372200 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:41.372164 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:41.472965 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:41.472939 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:41.574695 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:41.574672 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:41.727420 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:41.727356 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:46.084594 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:46.084547 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:46.167701 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:46.167671 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:46.607852 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:46.607820 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:46.702934 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:46.702906 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:47.421275 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.421243 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:47.421787 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.421283 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:47.421787 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.421319 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:47.421987 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.421955 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560ad04e-389c-4f1b-8b47-0a93e69b04d8-service-ca-bundle\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:47.423949 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.423928 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a607f451-c9cc-48e3-9820-38befc8ae26b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-h9ks9\" (UID: \"a607f451-c9cc-48e3-9820-38befc8ae26b\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:47.424039 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.424018 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560ad04e-389c-4f1b-8b47-0a93e69b04d8-metrics-certs\") pod \"router-default-685cd8b794-rd4s4\" (UID: \"560ad04e-389c-4f1b-8b47-0a93e69b04d8\") " pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:47.653877 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.653851 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cg2bn\"" Sep 19 01:40:47.661348 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.661322 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" Sep 19 01:40:47.677475 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.677425 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-clzxf\"" Sep 19 01:40:47.685163 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.685136 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:47.935292 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.935207 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9"] Sep 19 01:40:47.938821 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:47.938781 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda607f451_c9cc_48e3_9820_38befc8ae26b.slice/crio-466e2f779947e09b44cfe6bb57f5268b1ec311b18f030dbe575114396cb8acb8 WatchSource:0}: Error finding container 466e2f779947e09b44cfe6bb57f5268b1ec311b18f030dbe575114396cb8acb8: Status 404 returned error can't find the container with id 466e2f779947e09b44cfe6bb57f5268b1ec311b18f030dbe575114396cb8acb8 Sep 19 01:40:47.965688 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:47.965667 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-685cd8b794-rd4s4"] Sep 19 01:40:47.967432 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:47.967405 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560ad04e_389c_4f1b_8b47_0a93e69b04d8.slice/crio-919c6b80ff80cfa32d75679f57205c656951fee4c33a56a40e4c0cf535964fb2 WatchSource:0}: Error finding container 919c6b80ff80cfa32d75679f57205c656951fee4c33a56a40e4c0cf535964fb2: Status 404 returned error can't find the container with id 919c6b80ff80cfa32d75679f57205c656951fee4c33a56a40e4c0cf535964fb2 Sep 19 01:40:48.862775 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:48.862739 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" event={"ID":"a607f451-c9cc-48e3-9820-38befc8ae26b","Type":"ContainerStarted","Data":"466e2f779947e09b44cfe6bb57f5268b1ec311b18f030dbe575114396cb8acb8"} Sep 19 01:40:48.864510 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:48.864482 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-685cd8b794-rd4s4" event={"ID":"560ad04e-389c-4f1b-8b47-0a93e69b04d8","Type":"ContainerStarted","Data":"22eb74aebf4bed5e419f5c6e82f15f3e379f0c804c9ce7a9c54f3cc8175679e7"} Sep 19 01:40:48.864667 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:48.864530 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-685cd8b794-rd4s4" event={"ID":"560ad04e-389c-4f1b-8b47-0a93e69b04d8","Type":"ContainerStarted","Data":"919c6b80ff80cfa32d75679f57205c656951fee4c33a56a40e4c0cf535964fb2"} Sep 19 01:40:48.889750 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:48.889700 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-685cd8b794-rd4s4" podStartSLOduration=33.889679871 podStartE2EDuration="33.889679871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:48.888779869 +0000 UTC m=+88.621518124" watchObservedRunningTime="2026-09-19 01:40:48.889679871 +0000 UTC m=+88.622418124" Sep 19 01:40:49.686047 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:49.686008 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:49.689483 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:49.689457 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:49.871625 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:49.871602 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:49.872746 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:49.872725 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-685cd8b794-rd4s4" Sep 19 01:40:50.125989 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:50.125957 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:50.281535 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:50.281499 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:50.495742 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:50.495711 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:50.878599 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:50.878471 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" event={"ID":"a607f451-c9cc-48e3-9820-38befc8ae26b","Type":"ContainerStarted","Data":"cdc12df2b213b9530d515669a7c8e9508e5f7ffade38d9cd2eee6c90d474a838"} Sep 19 01:40:50.898145 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:50.898096 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-h9ks9" podStartSLOduration=34.020738561 podStartE2EDuration="35.898079979s" totalImagesPullingTime="1.877341418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:50.897383498 +0000 UTC m=+90.630121750" watchObservedRunningTime="2026-09-19 01:40:50.898079979 +0000 UTC m=+90.630818229" Sep 19 01:40:51.349692 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.349658 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c874474bc-tv2xj"] Sep 19 01:40:51.351559 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.351536 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.354458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.354437 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 19 01:40:51.355137 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.355120 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 19 01:40:51.355318 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.355304 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 19 01:40:51.355675 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.355659 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-49x4x\"" Sep 19 01:40:51.361652 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.361635 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 19 01:40:51.375438 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.375419 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c874474bc-tv2xj"] Sep 19 01:40:51.456283 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456255 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-registry-certificates\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.456382 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456315 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-bound-sa-token\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.456382 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456371 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4pbf\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-kube-api-access-d4pbf\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.456485 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456412 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-ca-trust-extracted\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.456485 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456433 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-trusted-ca\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.456485 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456457 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-registry-tls\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.456485 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456476 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-installation-pull-secrets\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.456656 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.456498 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-image-registry-private-configuration\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.466928 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.466895 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:51.552043 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.552015 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:51.557244 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557223 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-registry-certificates\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557278 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-bound-sa-token\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557297 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4pbf\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-kube-api-access-d4pbf\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557317 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-ca-trust-extracted\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557332 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-trusted-ca\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557353 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-registry-tls\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557371 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-installation-pull-secrets\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557391 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-image-registry-private-configuration\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.557878 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.557853 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-ca-trust-extracted\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.558115 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.558095 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-registry-certificates\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.558263 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.558244 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-trusted-ca\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.560019 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.559991 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-installation-pull-secrets\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.560142 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.560125 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-image-registry-private-configuration\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.560658 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.560638 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-registry-tls\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.569959 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.569932 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-bound-sa-token\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.570201 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.570180 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4pbf\" (UniqueName: \"kubernetes.io/projected/ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777-kube-api-access-d4pbf\") pod \"image-registry-5c874474bc-tv2xj\" (UID: \"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777\") " pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.651647 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.651560 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:51.661730 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.661709 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:51.939203 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:51.939166 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c874474bc-tv2xj"] Sep 19 01:40:51.941434 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:51.941399 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2e8fc3_4c69_4ac4_90e8_c0281a4e3777.slice/crio-b9ed0fd8260eed13002962e092d233f45cc5391fa13503ed6a5ee6a0ee40af63 WatchSource:0}: Error finding container b9ed0fd8260eed13002962e092d233f45cc5391fa13503ed6a5ee6a0ee40af63: Status 404 returned error can't find the container with id b9ed0fd8260eed13002962e092d233f45cc5391fa13503ed6a5ee6a0ee40af63 Sep 19 01:40:52.768231 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.768195 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:52.770418 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.770384 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2708af3-3132-4ca6-9568-68ddc2f7220b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhg94\" (UID: \"b2708af3-3132-4ca6-9568-68ddc2f7220b\") " pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:52.795429 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.795402 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:52.801335 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.801313 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vg5n6\"" Sep 19 01:40:52.808703 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.808681 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhg94" Sep 19 01:40:52.886947 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.886912 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" event={"ID":"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777","Type":"ContainerStarted","Data":"40fd3d05853aaec3ffad9c5cb255a3ff43338d6b8cddf63566a6779b4f7ac702"} Sep 19 01:40:52.887131 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.886995 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" event={"ID":"ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777","Type":"ContainerStarted","Data":"b9ed0fd8260eed13002962e092d233f45cc5391fa13503ed6a5ee6a0ee40af63"} Sep 19 01:40:52.887131 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.887020 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:40:52.912223 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:52.912167 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" podStartSLOduration=1.912148412 podStartE2EDuration="1.912148412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:52.911545227 +0000 UTC m=+92.644283480" watchObservedRunningTime="2026-09-19 01:40:52.912148412 +0000 UTC m=+92.644886669" Sep 19 01:40:53.125642 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:53.125551 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhg94"] Sep 19 01:40:53.128726 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:40:53.128698 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2708af3_3132_4ca6_9568_68ddc2f7220b.slice/crio-43fc3f6ae8281838179c4d1bb45e25183da4cc7fe63ab29db3727f36e5e4ef9f WatchSource:0}: Error finding container 43fc3f6ae8281838179c4d1bb45e25183da4cc7fe63ab29db3727f36e5e4ef9f: Status 404 returned error can't find the container with id 43fc3f6ae8281838179c4d1bb45e25183da4cc7fe63ab29db3727f36e5e4ef9f Sep 19 01:40:53.892035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:53.892001 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhg94" event={"ID":"b2708af3-3132-4ca6-9568-68ddc2f7220b","Type":"ContainerStarted","Data":"d3722d2a30a47272ce3a97d4fa322d1a6e6e751a478175b175110ed866656408"} Sep 19 01:40:53.892180 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:53.892058 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhg94" event={"ID":"b2708af3-3132-4ca6-9568-68ddc2f7220b","Type":"ContainerStarted","Data":"43fc3f6ae8281838179c4d1bb45e25183da4cc7fe63ab29db3727f36e5e4ef9f"} Sep 19 01:40:54.897619 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:54.897557 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhg94" event={"ID":"b2708af3-3132-4ca6-9568-68ddc2f7220b","Type":"ContainerStarted","Data":"66ce8cb30909eae22e2815287580cf43d7ad7bdcc905296c742a54f1fbf1ef64"} Sep 19 01:40:54.927038 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:54.927011 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:55.022182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:55.022158 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:56.907029 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:56.906989 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhg94" event={"ID":"b2708af3-3132-4ca6-9568-68ddc2f7220b","Type":"ContainerStarted","Data":"857fb9427e2b80752b6fc1d18d27fbe795946398ba193d23c38f1355ffeec526"} Sep 19 01:40:56.929849 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:56.929804 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jhg94" podStartSLOduration=34.194443796 podStartE2EDuration="36.929791526s" totalImagesPullingTime="2.73534773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:40:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:56.927678504 +0000 UTC m=+96.660416759" watchObservedRunningTime="2026-09-19 01:40:56.929791526 +0000 UTC m=+96.662529779" Sep 19 01:40:57.316767 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:57.316717 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:57.386423 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:57.386390 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:57.542138 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:57.542104 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:58.400490 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:58.400458 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:58.505915 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:58.505883 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:40:59.802623 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:40:59.802584 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrbdw" Sep 19 01:41:00.322168 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:00.322133 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:41:00.324583 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:00.324552 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb4ddc3-53d0-4609-93d8-921c8355736c-metrics-tls\") pod \"dns-default-x5lhn\" (UID: \"cfb4ddc3-53d0-4609-93d8-921c8355736c\") " pod="openshift-dns/dns-default-x5lhn" Sep 19 01:41:00.607385 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:00.607316 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttj8c\"" Sep 19 01:41:00.614828 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:00.614809 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x5lhn" Sep 19 01:41:00.890685 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:00.890665 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x5lhn"] Sep 19 01:41:00.892451 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:00.892427 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb4ddc3_53d0_4609_93d8_921c8355736c.slice/crio-1df63625742439386b6ace29494eea57cb2470e5639ae7d937c597795240df28 WatchSource:0}: Error finding container 1df63625742439386b6ace29494eea57cb2470e5639ae7d937c597795240df28: Status 404 returned error can't find the container with id 1df63625742439386b6ace29494eea57cb2470e5639ae7d937c597795240df28 Sep 19 01:41:00.921818 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:00.921792 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x5lhn" event={"ID":"cfb4ddc3-53d0-4609-93d8-921c8355736c","Type":"ContainerStarted","Data":"1df63625742439386b6ace29494eea57cb2470e5639ae7d937c597795240df28"} Sep 19 01:41:01.619721 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:01.619686 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:02.653945 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:02.653920 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:02.930250 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:02.930174 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x5lhn" event={"ID":"cfb4ddc3-53d0-4609-93d8-921c8355736c","Type":"ContainerStarted","Data":"6812699492a62702fd544257a16485a36df7d8bc0e50d7c814a27a7da9d3cb2a"} Sep 19 01:41:02.930250 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:02.930231 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x5lhn" event={"ID":"cfb4ddc3-53d0-4609-93d8-921c8355736c","Type":"ContainerStarted","Data":"e50af4dac308e600bf2322403e1dfaee667e2a5c396cce1de77e33af2731e22e"} Sep 19 01:41:02.930428 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:02.930284 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x5lhn" Sep 19 01:41:02.951937 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:02.951894 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x5lhn" podStartSLOduration=65.362714576 podStartE2EDuration="1m6.951880298s" totalImagesPullingTime="1.589165722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:02.950314129 +0000 UTC m=+102.683052396" watchObservedRunningTime="2026-09-19 01:41:02.951880298 +0000 UTC m=+102.684618550" Sep 19 01:41:03.011150 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:03.011119 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:03.108362 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:03.108329 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:04.480737 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.480690 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:04.592890 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.592857 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:04.714064 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.714029 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:04.724498 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.724473 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2"] Sep 19 01:41:04.727726 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.727709 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.730900 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.730853 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nn4w6\"" Sep 19 01:41:04.731125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.731107 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 19 01:41:04.731344 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.731328 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 19 01:41:04.732217 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.732203 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 19 01:41:04.737737 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.737707 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-dfxmw"] Sep 19 01:41:04.741115 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.741096 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.744314 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.744299 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 19 01:41:04.744520 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.744507 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 19 01:41:04.744885 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.744854 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5nkwv\"" Sep 19 01:41:04.744986 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.744968 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 19 01:41:04.750520 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.750499 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2"] Sep 19 01:41:04.754483 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.754462 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8pqh4"] Sep 19 01:41:04.757610 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.757592 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.761109 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.761084 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 19 01:41:04.761213 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.761195 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 19 01:41:04.761432 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.761411 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 19 01:41:04.761753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.761737 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sl9pg\"" Sep 19 01:41:04.763911 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.763893 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-dfxmw"] Sep 19 01:41:04.816592 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.816547 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:04.857067 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857042 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857172 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857073 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-wtmp\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857172 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857093 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857172 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857108 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98bb7689-c5f0-4e51-83c1-737139ca4a53-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.857278 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857201 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5rvb\" (UniqueName: \"kubernetes.io/projected/ae16acff-f860-4441-8de9-5c5b6b3cd97d-kube-api-access-m5rvb\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.857278 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857245 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.857339 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857276 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-sys\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857339 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857293 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.857339 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857317 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-tls\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857432 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857355 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-root\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857432 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857371 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlqsh\" (UniqueName: \"kubernetes.io/projected/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-api-access-qlqsh\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.857432 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857389 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/98bb7689-c5f0-4e51-83c1-737139ca4a53-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.857432 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857416 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae16acff-f860-4441-8de9-5c5b6b3cd97d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.857562 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857440 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-textfile\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857562 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857460 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae16acff-f860-4441-8de9-5c5b6b3cd97d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.857562 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857478 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-metrics-client-ca\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857562 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857494 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69scg\" (UniqueName: \"kubernetes.io/projected/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-kube-api-access-69scg\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.857562 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857555 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae16acff-f860-4441-8de9-5c5b6b3cd97d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.857757 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.857610 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.917543 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.917515 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:04.958429 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958404 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae16acff-f860-4441-8de9-5c5b6b3cd97d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.958522 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958434 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-textfile\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.958522 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958451 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae16acff-f860-4441-8de9-5c5b6b3cd97d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.958522 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958471 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-metrics-client-ca\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.958522 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958485 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69scg\" (UniqueName: \"kubernetes.io/projected/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-kube-api-access-69scg\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.958740 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958553 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae16acff-f860-4441-8de9-5c5b6b3cd97d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.958740 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958633 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.958740 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958665 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.958908 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958781 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-wtmp\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.958908 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958820 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.958908 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958849 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98bb7689-c5f0-4e51-83c1-737139ca4a53-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.958908 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958890 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5rvb\" (UniqueName: \"kubernetes.io/projected/ae16acff-f860-4441-8de9-5c5b6b3cd97d-kube-api-access-m5rvb\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.959101 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958923 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.959101 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958956 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-sys\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.959101 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958983 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.959276 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959254 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-tls\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.959352 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959328 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-metrics-client-ca\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.959430 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.958890 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-textfile\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959487 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-root\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959497 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-sys\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959528 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae16acff-f860-4441-8de9-5c5b6b3cd97d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959528 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlqsh\" (UniqueName: \"kubernetes.io/projected/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-api-access-qlqsh\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959606 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/98bb7689-c5f0-4e51-83c1-737139ca4a53-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959640 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-root\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959691 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.959794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959559 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-wtmp\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.960253 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.959986 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/98bb7689-c5f0-4e51-83c1-737139ca4a53-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.960253 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.960086 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98bb7689-c5f0-4e51-83c1-737139ca4a53-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.960253 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.960109 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.961868 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.961762 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.961981 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.961960 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.962615 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.962589 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-node-exporter-tls\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:04.962615 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.962600 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae16acff-f860-4441-8de9-5c5b6b3cd97d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.962736 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.962634 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.962988 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.962967 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae16acff-f860-4441-8de9-5c5b6b3cd97d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.982268 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.982216 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlqsh\" (UniqueName: \"kubernetes.io/projected/98bb7689-c5f0-4e51-83c1-737139ca4a53-kube-api-access-qlqsh\") pod \"kube-state-metrics-84c885658c-dfxmw\" (UID: \"98bb7689-c5f0-4e51-83c1-737139ca4a53\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:04.982352 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.982333 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5rvb\" (UniqueName: \"kubernetes.io/projected/ae16acff-f860-4441-8de9-5c5b6b3cd97d-kube-api-access-m5rvb\") pod \"openshift-state-metrics-86c5bc79d6-7v5j2\" (UID: \"ae16acff-f860-4441-8de9-5c5b6b3cd97d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:04.984391 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:04.984372 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69scg\" (UniqueName: \"kubernetes.io/projected/ac7cead6-dde6-42ad-ad5c-9e066d4a09ef-kube-api-access-69scg\") pod \"node-exporter-8pqh4\" (UID: \"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef\") " pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:05.039050 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.039028 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" Sep 19 01:41:05.051927 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.051906 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" Sep 19 01:41:05.054083 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.053997 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:05.067475 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.067451 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8pqh4" Sep 19 01:41:05.080963 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:05.080923 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7cead6_dde6_42ad_ad5c_9e066d4a09ef.slice/crio-9549bcfaa3dcd88a5b81020a4c3f7949807cec81dbe4cd53c9e6e35c6e2f5bf9 WatchSource:0}: Error finding container 9549bcfaa3dcd88a5b81020a4c3f7949807cec81dbe4cd53c9e6e35c6e2f5bf9: Status 404 returned error can't find the container with id 9549bcfaa3dcd88a5b81020a4c3f7949807cec81dbe4cd53c9e6e35c6e2f5bf9 Sep 19 01:41:05.154740 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.154692 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:05.253595 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.253500 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:05.347463 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.347441 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2"] Sep 19 01:41:05.349364 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:05.349340 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae16acff_f860_4441_8de9_5c5b6b3cd97d.slice/crio-e0001e50e6f893d90f31221268f359754cf2fb56add01c76cb3a27cf3b60c590 WatchSource:0}: Error finding container e0001e50e6f893d90f31221268f359754cf2fb56add01c76cb3a27cf3b60c590: Status 404 returned error can't find the container with id e0001e50e6f893d90f31221268f359754cf2fb56add01c76cb3a27cf3b60c590 Sep 19 01:41:05.357046 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.357025 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-dfxmw"] Sep 19 01:41:05.359637 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:05.359614 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bb7689_c5f0_4e51_83c1_737139ca4a53.slice/crio-4044862eee346edca9976f19170da98d9754c5219980cbc7cf40c95d35d0a2d4 WatchSource:0}: Error finding container 4044862eee346edca9976f19170da98d9754c5219980cbc7cf40c95d35d0a2d4: Status 404 returned error can't find the container with id 4044862eee346edca9976f19170da98d9754c5219980cbc7cf40c95d35d0a2d4 Sep 19 01:41:05.607234 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.607211 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:05.722312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.722272 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:05.813457 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.813366 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:05.814002 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.813981 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:41:05.832883 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.832825 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.833465 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.833435 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:41:05.836187 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.836162 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 19 01:41:05.836301 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.836234 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.836641 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.836707 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.836885 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.836930 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.837141 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.837246 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.837398 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 19 01:41:05.837598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.837457 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-72ltt\"" Sep 19 01:41:05.943632 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.943588 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pqh4" event={"ID":"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef","Type":"ContainerStarted","Data":"9549bcfaa3dcd88a5b81020a4c3f7949807cec81dbe4cd53c9e6e35c6e2f5bf9"} Sep 19 01:41:05.945257 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.945230 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" event={"ID":"98bb7689-c5f0-4e51-83c1-737139ca4a53","Type":"ContainerStarted","Data":"4044862eee346edca9976f19170da98d9754c5219980cbc7cf40c95d35d0a2d4"} Sep 19 01:41:05.947261 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.947238 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" event={"ID":"ae16acff-f860-4441-8de9-5c5b6b3cd97d","Type":"ContainerStarted","Data":"d4c46508fe813172dad6ab0cca207ef758dc2417adbf6c65ca13bd1b7f1ae0c3"} Sep 19 01:41:05.947375 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.947278 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" event={"ID":"ae16acff-f860-4441-8de9-5c5b6b3cd97d","Type":"ContainerStarted","Data":"6b6367f31a85457bc09d6c4e36716f8894d09b13f8d80610c2e4035ab9a0ce59"} Sep 19 01:41:05.947375 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.947299 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" event={"ID":"ae16acff-f860-4441-8de9-5c5b6b3cd97d","Type":"ContainerStarted","Data":"e0001e50e6f893d90f31221268f359754cf2fb56add01c76cb3a27cf3b60c590"} Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968643 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-volume\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968692 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvm7m\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-kube-api-access-tvm7m\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968720 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968757 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-out\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968780 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968812 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968874 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-web-config\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968928 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968951 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.968985 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.969021 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.969044 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:05.969206 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:05.969069 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070145 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.069949 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070457 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070433 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070578 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070478 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070578 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070527 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-volume\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070578 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070551 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvm7m\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-kube-api-access-tvm7m\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070746 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070600 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070746 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070650 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-out\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.070746 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070679 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.071538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070872 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.071538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070929 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-web-config\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.071538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.070996 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.071538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.071022 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.071538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.071068 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.071538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.071483 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.073690 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.073532 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.073690 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.073637 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.073880 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.073691 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.076171 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.076127 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.076301 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.076274 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.076370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.076297 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.077326 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.077288 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.077464 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.077425 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-volume\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.078015 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.077992 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-web-config\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.078136 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.078121 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.078914 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.078892 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-out\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.081689 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.081666 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvm7m\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-kube-api-access-tvm7m\") pod \"alertmanager-main-0\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.109967 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.109918 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:06.147051 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.147022 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:41:06.595598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.595549 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:41:06.630689 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.630658 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:06.823274 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.823237 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:06.872588 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:06.872503 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ba7079_cc43_4681_9bb3_ab7ebd58c9de.slice/crio-2533b0b3524eca99c0d81439ea3d6736334ec2a13de901e11719e9ecbe861192 WatchSource:0}: Error finding container 2533b0b3524eca99c0d81439ea3d6736334ec2a13de901e11719e9ecbe861192: Status 404 returned error can't find the container with id 2533b0b3524eca99c0d81439ea3d6736334ec2a13de901e11719e9ecbe861192 Sep 19 01:41:06.922822 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.922779 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:06.952955 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:06.952846 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerStarted","Data":"2533b0b3524eca99c0d81439ea3d6736334ec2a13de901e11719e9ecbe861192"} Sep 19 01:41:07.724587 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.724480 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c7f4f666d-sk682"] Sep 19 01:41:07.727335 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.727313 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.733535 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.733513 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 19 01:41:07.733679 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.733559 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 19 01:41:07.733773 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.733516 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 19 01:41:07.733991 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.733972 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 19 01:41:07.734777 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.734613 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 19 01:41:07.734868 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.734790 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-882wm\"" Sep 19 01:41:07.735080 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.735061 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9hkrgdk7ev9ue\"" Sep 19 01:41:07.770077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.770053 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c7f4f666d-sk682"] Sep 19 01:41:07.834473 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.834439 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:07.890729 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.890693 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.890905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.890767 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-grpc-tls\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.890905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.890803 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.890905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.890852 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.891117 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.890946 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.891117 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.890972 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e198d0e-fd1b-43e3-a37b-284a46640f3d-metrics-client-ca\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.891117 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.890995 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4crhm\" (UniqueName: \"kubernetes.io/projected/6e198d0e-fd1b-43e3-a37b-284a46640f3d-kube-api-access-4crhm\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.891117 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.891068 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-tls\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.906633 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.906601 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:07.958982 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.958951 2587 generic.go:356] "Generic (PLEG): container finished" podID="ac7cead6-dde6-42ad-ad5c-9e066d4a09ef" containerID="a8ea92523152ffba309d821190c3971607d63940f8a3c6946d8af7541faf3629" exitCode=0 Sep 19 01:41:07.959139 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.959067 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pqh4" event={"ID":"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef","Type":"ContainerDied","Data":"a8ea92523152ffba309d821190c3971607d63940f8a3c6946d8af7541faf3629"} Sep 19 01:41:07.962267 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.961742 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" event={"ID":"98bb7689-c5f0-4e51-83c1-737139ca4a53","Type":"ContainerStarted","Data":"5ff4a2b3dc86fd04f2228af324f02a9052665cb328d7f45451ad710f4c99afe5"} Sep 19 01:41:07.962267 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.961799 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" event={"ID":"98bb7689-c5f0-4e51-83c1-737139ca4a53","Type":"ContainerStarted","Data":"07a9d74de576baa342a37962cd56b752b8f8cdf85b994fba0ccf3e2b841f37e4"} Sep 19 01:41:07.962267 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.961829 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" event={"ID":"98bb7689-c5f0-4e51-83c1-737139ca4a53","Type":"ContainerStarted","Data":"03da1ad08dd05d81ad02d7cbeb7faf1d4c1f46ec0d7c3f54b66b70c3bf643d8e"} Sep 19 01:41:07.964991 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.964968 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" event={"ID":"ae16acff-f860-4441-8de9-5c5b6b3cd97d","Type":"ContainerStarted","Data":"f15fd9142066d3d6d23d173b237d830e8ebacc505c2503721683f38729e61f31"} Sep 19 01:41:07.991845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.991778 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-tls\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.991845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.991823 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.992006 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.991879 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-grpc-tls\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.992006 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.991906 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.992006 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.991951 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.992006 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.991984 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.992208 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.992006 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e198d0e-fd1b-43e3-a37b-284a46640f3d-metrics-client-ca\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.992208 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.992042 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4crhm\" (UniqueName: \"kubernetes.io/projected/6e198d0e-fd1b-43e3-a37b-284a46640f3d-kube-api-access-4crhm\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.993062 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.993013 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e198d0e-fd1b-43e3-a37b-284a46640f3d-metrics-client-ca\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.996384 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.995910 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.996384 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.995968 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.997553 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.997528 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.997856 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.997831 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.998354 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.998332 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-grpc-tls\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.998452 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.998422 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e198d0e-fd1b-43e3-a37b-284a46640f3d-secret-thanos-querier-tls\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:07.999631 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:07.999587 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7v5j2" podStartSLOduration=2.37209229 podStartE2EDuration="3.999547057s" totalImagesPullingTime="1.627454767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:07.997683027 +0000 UTC m=+107.730421283" watchObservedRunningTime="2026-09-19 01:41:07.999547057 +0000 UTC m=+107.732285311" Sep 19 01:41:08.002650 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.002608 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4crhm\" (UniqueName: \"kubernetes.io/projected/6e198d0e-fd1b-43e3-a37b-284a46640f3d-kube-api-access-4crhm\") pod \"thanos-querier-5c7f4f666d-sk682\" (UID: \"6e198d0e-fd1b-43e3-a37b-284a46640f3d\") " pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:08.019376 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.018440 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-dfxmw" podStartSLOduration=2.1747487149999998 podStartE2EDuration="4.018423834s" totalImagesPullingTime="1.843675119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:08.017450397 +0000 UTC m=+107.750188675" watchObservedRunningTime="2026-09-19 01:41:08.018423834 +0000 UTC m=+107.751162087" Sep 19 01:41:08.039602 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.039545 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:08.347484 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.347451 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c7f4f666d-sk682"] Sep 19 01:41:08.349090 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:08.349045 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e198d0e_fd1b_43e3_a37b_284a46640f3d.slice/crio-18059dccedb830543354ad56747a7c5414919a4236ba9928c5772c0e725bae12 WatchSource:0}: Error finding container 18059dccedb830543354ad56747a7c5414919a4236ba9928c5772c0e725bae12: Status 404 returned error can't find the container with id 18059dccedb830543354ad56747a7c5414919a4236ba9928c5772c0e725bae12 Sep 19 01:41:08.396147 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.396109 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:08.456505 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.456477 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:08.552036 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.551971 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:08.850836 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.850775 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:08.971945 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.971913 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pqh4" event={"ID":"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef","Type":"ContainerStarted","Data":"f0edbe2b2bb891e01f1f9eb5f3e690480d3ac96b42f7d2be9be78785e2c9891d"} Sep 19 01:41:08.972074 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.971975 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pqh4" event={"ID":"ac7cead6-dde6-42ad-ad5c-9e066d4a09ef","Type":"ContainerStarted","Data":"dc351186414a15dffaaf3d04f1ea4ca845c9c4b48f25779c4bc86b1207093071"} Sep 19 01:41:08.973511 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.973477 2587 generic.go:356] "Generic (PLEG): container finished" podID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerID="91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6" exitCode=0 Sep 19 01:41:08.973640 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.973558 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6"} Sep 19 01:41:08.974692 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.974667 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" event={"ID":"6e198d0e-fd1b-43e3-a37b-284a46640f3d","Type":"ContainerStarted","Data":"18059dccedb830543354ad56747a7c5414919a4236ba9928c5772c0e725bae12"} Sep 19 01:41:08.997441 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:08.997384 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8pqh4" podStartSLOduration=2.7899251449999998 podStartE2EDuration="4.997366396s" totalImagesPullingTime="2.115887341s" totalInitContainerRuntime="91.55391ms" isStatefulPod=true podCreationTimestamp="2026-09-19 01:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:08.99534631 +0000 UTC m=+108.728084560" watchObservedRunningTime="2026-09-19 01:41:08.997366396 +0000 UTC m=+108.730104650" Sep 19 01:41:09.487892 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:09.487847 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:09.589673 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:09.589622 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:09.768072 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:09.767995 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:10.611882 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.611848 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-754b9fd98f-vvcl5"] Sep 19 01:41:10.614328 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.614300 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:10.615752 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.615733 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.618684 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.618663 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 19 01:41:10.618684 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.618681 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 19 01:41:10.619233 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.619215 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 19 01:41:10.619961 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.619942 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 19 01:41:10.620073 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.620058 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 19 01:41:10.620312 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.620297 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 19 01:41:10.620545 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.620502 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 19 01:41:10.620684 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.620561 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jm6bh\"" Sep 19 01:41:10.625934 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.625912 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 19 01:41:10.627077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.627052 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754b9fd98f-vvcl5"] Sep 19 01:41:10.679999 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.679933 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:10.719159 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.719124 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-serving-cert\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.719306 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.719163 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-oauth-config\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.719306 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.719195 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-trusted-ca-bundle\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.719306 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.719233 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-service-ca\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.719306 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.719262 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkn5h\" (UniqueName: \"kubernetes.io/projected/08b0dad6-0497-4f0f-b894-143e6d1d83a9-kube-api-access-hkn5h\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.719306 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.719288 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-config\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.719502 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.719319 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-oauth-serving-cert\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.820683 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.820652 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-serving-cert\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.820800 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.820693 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-oauth-config\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.820800 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.820715 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-trusted-ca-bundle\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.820800 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.820750 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-service-ca\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.820800 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.820767 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkn5h\" (UniqueName: \"kubernetes.io/projected/08b0dad6-0497-4f0f-b894-143e6d1d83a9-kube-api-access-hkn5h\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.820800 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.820785 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-config\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.821045 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.820811 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-oauth-serving-cert\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.821839 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.821745 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-service-ca\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.821839 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.821795 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-oauth-serving-cert\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.821993 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.821872 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-config\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.822122 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.822101 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-trusted-ca-bundle\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.823720 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.823671 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-serving-cert\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.823812 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.823736 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-oauth-config\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.829614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.829596 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkn5h\" (UniqueName: \"kubernetes.io/projected/08b0dad6-0497-4f0f-b894-143e6d1d83a9-kube-api-access-hkn5h\") pod \"console-754b9fd98f-vvcl5\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.928195 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.928166 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:10.988739 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.988325 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerStarted","Data":"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794"} Sep 19 01:41:10.988739 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.988450 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerStarted","Data":"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027"} Sep 19 01:41:10.991350 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.991289 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" event={"ID":"6e198d0e-fd1b-43e3-a37b-284a46640f3d","Type":"ContainerStarted","Data":"9c11613e465055579d8b4826304c199d520d58e020176193f22110031c7a684f"} Sep 19 01:41:10.991350 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:10.991345 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" event={"ID":"6e198d0e-fd1b-43e3-a37b-284a46640f3d","Type":"ContainerStarted","Data":"a813cacd25cccc5bc04cde49573dc6268ac6b7738c1f57daf9ce056bf5b4ce42"} Sep 19 01:41:11.178146 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:11.178112 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:11.213962 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:11.213935 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754b9fd98f-vvcl5"] Sep 19 01:41:11.216290 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:11.216261 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b0dad6_0497_4f0f_b894_143e6d1d83a9.slice/crio-19d8ddad45fbd78b84a5a913c685e2b403888b0f7367589c5294788003d03244 WatchSource:0}: Error finding container 19d8ddad45fbd78b84a5a913c685e2b403888b0f7367589c5294788003d03244: Status 404 returned error can't find the container with id 19d8ddad45fbd78b84a5a913c685e2b403888b0f7367589c5294788003d03244 Sep 19 01:41:11.630175 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:11.630139 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:11.702058 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:11.702016 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:12.004246 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.004210 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerStarted","Data":"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776"} Sep 19 01:41:12.004385 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.004295 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerStarted","Data":"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6"} Sep 19 01:41:12.004385 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.004333 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerStarted","Data":"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1"} Sep 19 01:41:12.004385 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.004372 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerStarted","Data":"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7"} Sep 19 01:41:12.011221 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.010488 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" event={"ID":"6e198d0e-fd1b-43e3-a37b-284a46640f3d","Type":"ContainerStarted","Data":"f70c068859c7ea4df2ef35bd68c1dbe8db9af50999385cae849feb515e6d8f77"} Sep 19 01:41:12.011221 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.010559 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" event={"ID":"6e198d0e-fd1b-43e3-a37b-284a46640f3d","Type":"ContainerStarted","Data":"6d48cc40c2c93e4397783362d6dcf9a3c0d46464fc095e9e76c86196a84ecad1"} Sep 19 01:41:12.011221 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.010710 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" event={"ID":"6e198d0e-fd1b-43e3-a37b-284a46640f3d","Type":"ContainerStarted","Data":"456e13eed922615a286d3747d595db3ba38284a86df500a16c7b0ed309f0af1e"} Sep 19 01:41:12.011221 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.010750 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" event={"ID":"6e198d0e-fd1b-43e3-a37b-284a46640f3d","Type":"ContainerStarted","Data":"551c8819573c0a97ea4d3a78c2e1656e60b0ac1fde2931f2aa5e378b0104b754"} Sep 19 01:41:12.011221 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.010793 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:12.012527 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.012473 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b9fd98f-vvcl5" event={"ID":"08b0dad6-0497-4f0f-b894-143e6d1d83a9","Type":"ContainerStarted","Data":"19d8ddad45fbd78b84a5a913c685e2b403888b0f7367589c5294788003d03244"} Sep 19 01:41:12.044041 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.043982 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.361299071 podStartE2EDuration="7.04395994s" totalImagesPullingTime="3.663103861s" totalInitContainerRuntime="19.557008ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:12.041757604 +0000 UTC m=+111.774495882" watchObservedRunningTime="2026-09-19 01:41:12.04395994 +0000 UTC m=+111.776698195" Sep 19 01:41:12.936146 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.936113 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x5lhn" Sep 19 01:41:12.962491 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:12.962436 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" podStartSLOduration=2.765283021 podStartE2EDuration="5.962418671s" totalImagesPullingTime="3.19713565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:12.077097142 +0000 UTC m=+111.809835407" watchObservedRunningTime="2026-09-19 01:41:12.962418671 +0000 UTC m=+112.695156924" Sep 19 01:41:13.333762 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:13.333725 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:13.405782 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:13.405743 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:13.898320 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:13.898287 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c874474bc-tv2xj" Sep 19 01:41:14.065074 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:14.065034 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:14.134933 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:14.134898 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:14.212774 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:14.212750 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:16.034259 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:16.034225 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b9fd98f-vvcl5" event={"ID":"08b0dad6-0497-4f0f-b894-143e6d1d83a9","Type":"ContainerStarted","Data":"4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db"} Sep 19 01:41:16.054762 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:16.054710 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-754b9fd98f-vvcl5" podStartSLOduration=1.795454645 podStartE2EDuration="6.054694808s" totalImagesPullingTime="4.259240163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:16.052012843 +0000 UTC m=+115.784751095" watchObservedRunningTime="2026-09-19 01:41:16.054694808 +0000 UTC m=+115.787433060" Sep 19 01:41:17.369294 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:17.369241 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:17.518056 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:17.518026 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:18.023808 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:18.023784 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c7f4f666d-sk682" Sep 19 01:41:19.137959 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:19.137927 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:19.237726 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:19.237669 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:19.645420 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:19.645376 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:19.720531 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:19.720495 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:20.928695 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:20.928665 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:20.929064 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:20.928727 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:20.933264 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:20.933242 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:21.057504 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:21.057479 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:41:21.287322 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:21.287290 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:21.621534 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:21.621455 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:21.721087 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:21.721048 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:24.580973 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:24.580945 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:24.682466 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:24.682441 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:25.357659 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:25.357629 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:25.558712 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:25.558687 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:26.389090 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:26.389058 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:26.487637 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:26.487610 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:31.074691 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:31.074657 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:31.276712 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:31.276681 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:32.304527 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:32.304493 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:41:32.307041 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:32.307003 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08b545de-27d7-46fa-9195-3782f8cd7f21-metrics-certs\") pod \"network-metrics-daemon-dxcb4\" (UID: \"08b545de-27d7-46fa-9195-3782f8cd7f21\") " pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:41:32.530293 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:32.530266 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mflb\"" Sep 19 01:41:32.537975 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:32.537954 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxcb4" Sep 19 01:41:32.817628 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:32.817601 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dxcb4"] Sep 19 01:41:32.819884 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:41:32.819855 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b545de_27d7_46fa_9195_3782f8cd7f21.slice/crio-104daef211b66fc855c3d431b1b54d0a67c10076b4ffc532b1a3fa5d7488e27a WatchSource:0}: Error finding container 104daef211b66fc855c3d431b1b54d0a67c10076b4ffc532b1a3fa5d7488e27a: Status 404 returned error can't find the container with id 104daef211b66fc855c3d431b1b54d0a67c10076b4ffc532b1a3fa5d7488e27a Sep 19 01:41:33.103286 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:33.103251 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxcb4" event={"ID":"08b545de-27d7-46fa-9195-3782f8cd7f21","Type":"ContainerStarted","Data":"104daef211b66fc855c3d431b1b54d0a67c10076b4ffc532b1a3fa5d7488e27a"} Sep 19 01:41:34.109416 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:34.109340 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxcb4" event={"ID":"08b545de-27d7-46fa-9195-3782f8cd7f21","Type":"ContainerStarted","Data":"45d01e7621d57e1fdb8fb9e4cf50f89550d77995206430b315545f43388f9380"} Sep 19 01:41:34.109780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:34.109433 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxcb4" event={"ID":"08b545de-27d7-46fa-9195-3782f8cd7f21","Type":"ContainerStarted","Data":"a36445da6bde1a3f5d5d288e9e6030b99cb0554d6a7418b1186b306672f2f956"} Sep 19 01:41:34.128334 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:34.128289 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dxcb4" podStartSLOduration=131.160290888 podStartE2EDuration="2m12.128275642s" totalImagesPullingTime="967.984754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:34.127196314 +0000 UTC m=+133.859934568" watchObservedRunningTime="2026-09-19 01:41:34.128275642 +0000 UTC m=+133.861013895" Sep 19 01:41:34.246578 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:34.246534 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:34.331610 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:34.331552 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:39.035905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:39.035868 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:41.343672 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:41.343636 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685cd8b794-rd4s4_560ad04e-389c-4f1b-8b47-0a93e69b04d8/router/0.log" Sep 19 01:41:41.369726 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:41.369704 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbfrx_30d4b3b9-0f41-498a-b012-6c68895e93c4/serve-healthcheck-canary/0.log" Sep 19 01:41:45.385958 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:45.385924 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:45.534342 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:45.534313 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:52.191228 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:52.191189 2587 generic.go:356] "Generic (PLEG): container finished" podID="167c0574-1417-4fa3-9c0d-fb4470996fc9" containerID="edfe5b3e2ee34ebad6ff8cf8fcb4376acc6e44ae9f5cd113e084e8673c8e0cb9" exitCode=0 Sep 19 01:41:52.191719 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:52.191271 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" event={"ID":"167c0574-1417-4fa3-9c0d-fb4470996fc9","Type":"ContainerDied","Data":"edfe5b3e2ee34ebad6ff8cf8fcb4376acc6e44ae9f5cd113e084e8673c8e0cb9"} Sep 19 01:41:52.191719 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:52.191664 2587 scope.go:117] "RemoveContainer" containerID="edfe5b3e2ee34ebad6ff8cf8fcb4376acc6e44ae9f5cd113e084e8673c8e0cb9" Sep 19 01:41:53.200895 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:53.200845 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qkhs7" event={"ID":"167c0574-1417-4fa3-9c0d-fb4470996fc9","Type":"ContainerStarted","Data":"6bfb34e6479330411ce76aaede7b7dd9da270002f4da46a62caa1b52fb849c90"} Sep 19 01:41:54.487326 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:54.487288 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:54.588664 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:54.588630 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:41:54.687674 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:41:54.687622 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:42:24.161839 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:24.161799 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:42:24.362336 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:24.362302 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:42:25.230801 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:25.230766 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:42:25.231182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:25.231034 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="alertmanager" containerID="cri-o://8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027" gracePeriod=120 Sep 19 01:42:25.231182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:25.231114 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-metric" containerID="cri-o://250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6" gracePeriod=120 Sep 19 01:42:25.231182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:25.231142 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="config-reloader" containerID="cri-o://46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794" gracePeriod=120 Sep 19 01:42:25.231182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:25.231163 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="prom-label-proxy" containerID="cri-o://dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776" gracePeriod=120 Sep 19 01:42:25.231402 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:25.231114 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-web" containerID="cri-o://30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7" gracePeriod=120 Sep 19 01:42:25.231402 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:25.231178 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy" containerID="cri-o://34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1" gracePeriod=120 Sep 19 01:42:26.342397 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342370 2587 generic.go:356] "Generic (PLEG): container finished" podID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerID="dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776" exitCode=0 Sep 19 01:42:26.342397 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342394 2587 generic.go:356] "Generic (PLEG): container finished" podID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerID="34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1" exitCode=0 Sep 19 01:42:26.342397 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342400 2587 generic.go:356] "Generic (PLEG): container finished" podID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerID="46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794" exitCode=0 Sep 19 01:42:26.342824 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342406 2587 generic.go:356] "Generic (PLEG): container finished" podID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerID="8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027" exitCode=0 Sep 19 01:42:26.342824 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342444 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776"} Sep 19 01:42:26.342824 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342519 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1"} Sep 19 01:42:26.342824 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342549 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794"} Sep 19 01:42:26.342824 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.342654 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027"} Sep 19 01:42:26.473121 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.473097 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:26.525955 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.525923 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-out\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526089 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.525978 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-main-tls\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526089 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526031 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-web-config\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526089 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526061 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526243 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526095 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvm7m\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-kube-api-access-tvm7m\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526243 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526124 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-main-db\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526243 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526153 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-cluster-tls-config\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526243 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526199 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-tls-assets\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526451 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526247 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-trusted-ca-bundle\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526451 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526273 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-volume\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526451 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526309 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-metrics-client-ca\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526451 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526338 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.526451 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.526373 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-web\") pod \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\" (UID: \"71ba7079-cc43-4681-9bb3-ab7ebd58c9de\") " Sep 19 01:42:26.527351 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.527284 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:26.527882 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.527623 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:42:26.528500 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.528229 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:26.531109 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.531062 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:26.531332 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.531297 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-out" (OuterVolumeSpecName: "config-out") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:42:26.531663 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.531625 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-volume" (OuterVolumeSpecName: "config-volume") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:26.531772 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.531718 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:26.532204 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.532170 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:26.532288 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.532214 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-kube-api-access-tvm7m" (OuterVolumeSpecName: "kube-api-access-tvm7m") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "kube-api-access-tvm7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:42:26.532346 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.532310 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:26.532980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.532957 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:42:26.535590 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.535547 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:26.542115 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.542093 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-web-config" (OuterVolumeSpecName: "web-config") pod "71ba7079-cc43-4681-9bb3-ab7ebd58c9de" (UID: "71ba7079-cc43-4681-9bb3-ab7ebd58c9de"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:26.627924 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627848 2587 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-out\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.627924 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627885 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-main-tls\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.627924 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627899 2587 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-web-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.627924 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627916 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627930 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvm7m\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-kube-api-access-tvm7m\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627943 2587 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-main-db\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627959 2587 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-cluster-tls-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627972 2587 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-tls-assets\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.627986 2587 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.628000 2587 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-config-volume\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.628015 2587 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-metrics-client-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.628030 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:26.628160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:26.628049 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ba7079-cc43-4681-9bb3-ab7ebd58c9de-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:42:27.351417 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.351380 2587 generic.go:356] "Generic (PLEG): container finished" podID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerID="250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6" exitCode=0 Sep 19 01:42:27.351417 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.351405 2587 generic.go:356] "Generic (PLEG): container finished" podID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerID="30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7" exitCode=0 Sep 19 01:42:27.351875 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.351462 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6"} Sep 19 01:42:27.351875 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.351546 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7"} Sep 19 01:42:27.351875 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.351484 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.351875 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.351590 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71ba7079-cc43-4681-9bb3-ab7ebd58c9de","Type":"ContainerDied","Data":"2533b0b3524eca99c0d81439ea3d6736334ec2a13de901e11719e9ecbe861192"} Sep 19 01:42:27.351875 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.351615 2587 scope.go:117] "RemoveContainer" containerID="dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776" Sep 19 01:42:27.360598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.360561 2587 scope.go:117] "RemoveContainer" containerID="250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6" Sep 19 01:42:27.367880 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.367865 2587 scope.go:117] "RemoveContainer" containerID="34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1" Sep 19 01:42:27.374581 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.374550 2587 scope.go:117] "RemoveContainer" containerID="30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7" Sep 19 01:42:27.377152 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.377130 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:42:27.382153 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.382134 2587 scope.go:117] "RemoveContainer" containerID="46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794" Sep 19 01:42:27.382210 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.382177 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:42:27.389090 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.389076 2587 scope.go:117] "RemoveContainer" containerID="8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027" Sep 19 01:42:27.395843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.395816 2587 scope.go:117] "RemoveContainer" containerID="91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6" Sep 19 01:42:27.402593 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.402560 2587 scope.go:117] "RemoveContainer" containerID="dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776" Sep 19 01:42:27.402855 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:42:27.402835 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776\": container with ID starting with dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776 not found: ID does not exist" containerID="dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776" Sep 19 01:42:27.402905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.402862 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776"} err="failed to get container status \"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776\": rpc error: code = NotFound desc = could not find container \"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776\": container with ID starting with dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776 not found: ID does not exist" Sep 19 01:42:27.402905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.402892 2587 scope.go:117] "RemoveContainer" containerID="250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6" Sep 19 01:42:27.403139 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:42:27.403122 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6\": container with ID starting with 250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6 not found: ID does not exist" containerID="250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6" Sep 19 01:42:27.403181 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403145 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6"} err="failed to get container status \"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6\": rpc error: code = NotFound desc = could not find container \"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6\": container with ID starting with 250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6 not found: ID does not exist" Sep 19 01:42:27.403181 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403159 2587 scope.go:117] "RemoveContainer" containerID="34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1" Sep 19 01:42:27.403401 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:42:27.403385 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1\": container with ID starting with 34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1 not found: ID does not exist" containerID="34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1" Sep 19 01:42:27.403449 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403405 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1"} err="failed to get container status \"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1\": rpc error: code = NotFound desc = could not find container \"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1\": container with ID starting with 34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1 not found: ID does not exist" Sep 19 01:42:27.403449 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403417 2587 scope.go:117] "RemoveContainer" containerID="30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7" Sep 19 01:42:27.403681 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:42:27.403664 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7\": container with ID starting with 30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7 not found: ID does not exist" containerID="30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7" Sep 19 01:42:27.403734 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403687 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7"} err="failed to get container status \"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7\": rpc error: code = NotFound desc = could not find container \"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7\": container with ID starting with 30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7 not found: ID does not exist" Sep 19 01:42:27.403734 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403700 2587 scope.go:117] "RemoveContainer" containerID="46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794" Sep 19 01:42:27.403942 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:42:27.403924 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794\": container with ID starting with 46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794 not found: ID does not exist" containerID="46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794" Sep 19 01:42:27.403985 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403949 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794"} err="failed to get container status \"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794\": rpc error: code = NotFound desc = could not find container \"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794\": container with ID starting with 46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794 not found: ID does not exist" Sep 19 01:42:27.403985 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.403962 2587 scope.go:117] "RemoveContainer" containerID="8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027" Sep 19 01:42:27.404182 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:42:27.404166 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027\": container with ID starting with 8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027 not found: ID does not exist" containerID="8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027" Sep 19 01:42:27.404220 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404186 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027"} err="failed to get container status \"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027\": rpc error: code = NotFound desc = could not find container \"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027\": container with ID starting with 8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027 not found: ID does not exist" Sep 19 01:42:27.404220 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404198 2587 scope.go:117] "RemoveContainer" containerID="91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6" Sep 19 01:42:27.404427 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:42:27.404413 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6\": container with ID starting with 91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6 not found: ID does not exist" containerID="91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6" Sep 19 01:42:27.404462 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404431 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6"} err="failed to get container status \"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6\": rpc error: code = NotFound desc = could not find container \"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6\": container with ID starting with 91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6 not found: ID does not exist" Sep 19 01:42:27.404462 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404443 2587 scope.go:117] "RemoveContainer" containerID="dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776" Sep 19 01:42:27.404672 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404654 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776"} err="failed to get container status \"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776\": rpc error: code = NotFound desc = could not find container \"dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776\": container with ID starting with dd00d23b718adc13ca9ad566e54496c22ce88eff8e3f99512418940a0daa7776 not found: ID does not exist" Sep 19 01:42:27.404725 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404672 2587 scope.go:117] "RemoveContainer" containerID="250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6" Sep 19 01:42:27.404870 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404852 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6"} err="failed to get container status \"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6\": rpc error: code = NotFound desc = could not find container \"250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6\": container with ID starting with 250ea50d26f6bb984ebef8eee414dc80372fc8bae1dd8d5dd64cf74c9c45aec6 not found: ID does not exist" Sep 19 01:42:27.404923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.404871 2587 scope.go:117] "RemoveContainer" containerID="34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1" Sep 19 01:42:27.405114 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405091 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1"} err="failed to get container status \"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1\": rpc error: code = NotFound desc = could not find container \"34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1\": container with ID starting with 34ed70c6a0ac5f0912f494679473ca788c5a8de3f2b5add30bb76c58f0f205f1 not found: ID does not exist" Sep 19 01:42:27.405187 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405116 2587 scope.go:117] "RemoveContainer" containerID="30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7" Sep 19 01:42:27.405372 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405354 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7"} err="failed to get container status \"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7\": rpc error: code = NotFound desc = could not find container \"30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7\": container with ID starting with 30eba7adb166b1a4fe9db3fc990139e19112a95c29de55aa3306fd450bb063b7 not found: ID does not exist" Sep 19 01:42:27.405422 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405373 2587 scope.go:117] "RemoveContainer" containerID="46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794" Sep 19 01:42:27.405625 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405603 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794"} err="failed to get container status \"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794\": rpc error: code = NotFound desc = could not find container \"46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794\": container with ID starting with 46b7b14e866bcd25480129152a59be2c199f5ff084cd1a771121b2aa4f93c794 not found: ID does not exist" Sep 19 01:42:27.405696 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405627 2587 scope.go:117] "RemoveContainer" containerID="8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027" Sep 19 01:42:27.405903 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405882 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027"} err="failed to get container status \"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027\": rpc error: code = NotFound desc = could not find container \"8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027\": container with ID starting with 8c8bb5781d912af570ddfa3f81361a9a540dad6c586ec19a533350ecd98c8027 not found: ID does not exist" Sep 19 01:42:27.405973 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.405905 2587 scope.go:117] "RemoveContainer" containerID="91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6" Sep 19 01:42:27.406174 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.406141 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6"} err="failed to get container status \"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6\": rpc error: code = NotFound desc = could not find container \"91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6\": container with ID starting with 91133e85abdacb0b44c625e6eb2eb9de4cbe9c01761c3e640ac82e303ee2dba6 not found: ID does not exist" Sep 19 01:42:27.423293 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423271 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:42:27.423625 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423609 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-metric" Sep 19 01:42:27.423704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423628 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-metric" Sep 19 01:42:27.423704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423643 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="alertmanager" Sep 19 01:42:27.423704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423652 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="alertmanager" Sep 19 01:42:27.423704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423665 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy" Sep 19 01:42:27.423704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423674 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy" Sep 19 01:42:27.423704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423701 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="prom-label-proxy" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423711 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="prom-label-proxy" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423726 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-web" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423734 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-web" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423745 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="init-config-reloader" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423754 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="init-config-reloader" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423765 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="config-reloader" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423774 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="config-reloader" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423851 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="prom-label-proxy" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423864 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423872 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-metric" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423885 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="alertmanager" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423893 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="kube-rbac-proxy-web" Sep 19 01:42:27.423980 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.423903 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" containerName="config-reloader" Sep 19 01:42:27.427388 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.427369 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.433370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.433328 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 19 01:42:27.435215 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.434645 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 19 01:42:27.436843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.435329 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 19 01:42:27.436843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.435691 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 19 01:42:27.436843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.436082 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 19 01:42:27.436843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.436152 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 19 01:42:27.436843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.436280 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 19 01:42:27.436843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.436603 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 19 01:42:27.436843 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.436678 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-72ltt\"" Sep 19 01:42:27.442903 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.442883 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 19 01:42:27.443241 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.443222 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:42:27.537149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537120 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537262 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537166 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537262 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537186 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537262 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537205 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxfnf\" (UniqueName: \"kubernetes.io/projected/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-kube-api-access-xxfnf\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537262 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537253 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-config-out\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537283 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537328 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537347 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537361 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537374 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537391 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-web-config\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537667 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537448 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.537667 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.537501 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638059 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638094 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638119 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638143 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638172 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-web-config\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638205 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638240 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638275 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638323 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638671 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638352 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638671 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638383 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxfnf\" (UniqueName: \"kubernetes.io/projected/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-kube-api-access-xxfnf\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638671 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638418 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-config-out\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638671 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638453 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.638884 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.638867 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.639445 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.639031 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.639833 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.639783 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.641637 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.641592 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642023 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.641992 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642632 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.642449 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642632 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.642514 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-web-config\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642632 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.642511 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642632 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.642559 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.642644 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.642653 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-config-out\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.642884 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.642852 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.647825 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.647807 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxfnf\" (UniqueName: \"kubernetes.io/projected/d8556a17-b2cc-4327-a59a-359ce9ed1aeb-kube-api-access-xxfnf\") pod \"alertmanager-main-0\" (UID: \"d8556a17-b2cc-4327-a59a-359ce9ed1aeb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:27.737818 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:27.737800 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 01:42:28.031596 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:28.031555 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 01:42:28.033726 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:42:28.033699 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8556a17_b2cc_4327_a59a_359ce9ed1aeb.slice/crio-d17e384e7f46b486e3c80fef9a3c075121d370ebce3033ab573980394fde03ee WatchSource:0}: Error finding container d17e384e7f46b486e3c80fef9a3c075121d370ebce3033ab573980394fde03ee: Status 404 returned error can't find the container with id d17e384e7f46b486e3c80fef9a3c075121d370ebce3033ab573980394fde03ee Sep 19 01:42:28.356479 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:28.356395 2587 generic.go:356] "Generic (PLEG): container finished" podID="d8556a17-b2cc-4327-a59a-359ce9ed1aeb" containerID="4251200c47abbe7718daf6d389889ca489da9832333d0237d5abd79787b3c4ef" exitCode=0 Sep 19 01:42:28.356884 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:28.356482 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerDied","Data":"4251200c47abbe7718daf6d389889ca489da9832333d0237d5abd79787b3c4ef"} Sep 19 01:42:28.356884 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:28.356545 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerStarted","Data":"d17e384e7f46b486e3c80fef9a3c075121d370ebce3033ab573980394fde03ee"} Sep 19 01:42:28.516367 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:28.516333 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ba7079-cc43-4681-9bb3-ab7ebd58c9de" path="/var/lib/kubelet/pods/71ba7079-cc43-4681-9bb3-ab7ebd58c9de/volumes" Sep 19 01:42:29.259665 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.259631 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-579fff4bc7-jfs4h"] Sep 19 01:42:29.263185 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.263168 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.268041 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.268016 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 19 01:42:29.268158 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.268018 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 19 01:42:29.268158 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.268135 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 19 01:42:29.268417 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.268400 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gmztt\"" Sep 19 01:42:29.268493 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.268478 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 19 01:42:29.268908 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.268892 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 19 01:42:29.279704 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.275196 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 19 01:42:29.284789 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.284766 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-579fff4bc7-jfs4h"] Sep 19 01:42:29.354794 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.354759 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-serving-certs-ca-bundle\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.354916 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.354818 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-metrics-client-ca\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.354916 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.354869 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.355011 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.354936 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg4s8\" (UniqueName: \"kubernetes.io/projected/d86b1a22-e16a-4495-b0ec-839c281c17af-kube-api-access-dg4s8\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.355011 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.354992 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-telemeter-client-tls\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.355082 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.355022 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.355082 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.355043 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-federate-client-tls\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.355082 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.355065 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-secret-telemeter-client\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.365629 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.365603 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerStarted","Data":"4d41eb20338a68598d282e9e655d4e883148ae984ee38eb2aa4f092f7c9a85a3"} Sep 19 01:42:29.365918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.365658 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerStarted","Data":"d33aa9fe0e776c8a576abd85c4b9e3351daec505cdb6b4e2cc665ee5bc59395c"} Sep 19 01:42:29.365918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.365686 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerStarted","Data":"f42d8cc24bf2793a8293be3282e95e3e1390969dad071c170362113d167ffcd4"} Sep 19 01:42:29.365918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.365709 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerStarted","Data":"0b31d5eb22faa2b8c89efd7842f5e3b00bd6897294a4f085e41901c16b9bbe8f"} Sep 19 01:42:29.365918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.365734 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerStarted","Data":"5987139bfe6a5fb90fc6c18c093acb12fbaa2d29743cf97a2f335694e0cb39fb"} Sep 19 01:42:29.365918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.365757 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8556a17-b2cc-4327-a59a-359ce9ed1aeb","Type":"ContainerStarted","Data":"99eba9a4851fd8ec00396c84b8fbda43c016a7342a75a7f3469a27c37846b023"} Sep 19 01:42:29.396912 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.396861 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.377525578 podStartE2EDuration="2.396843482s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.317904ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:42:29.396072477 +0000 UTC m=+189.128810730" watchObservedRunningTime="2026-09-19 01:42:29.396843482 +0000 UTC m=+189.129581736" Sep 19 01:42:29.456450 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.456416 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.456591 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.456455 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-federate-client-tls\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.456653 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.456616 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-secret-telemeter-client\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.456814 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.456786 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-serving-certs-ca-bundle\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.457785 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.456898 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-metrics-client-ca\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.457785 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.456944 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.457785 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.457065 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg4s8\" (UniqueName: \"kubernetes.io/projected/d86b1a22-e16a-4495-b0ec-839c281c17af-kube-api-access-dg4s8\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.457785 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.457359 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-telemeter-client-tls\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.457785 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.457622 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-metrics-client-ca\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.457785 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.457646 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-serving-certs-ca-bundle\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.458434 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.458406 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d86b1a22-e16a-4495-b0ec-839c281c17af-telemeter-trusted-ca-bundle\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.459434 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.459385 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-federate-client-tls\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.459688 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.459665 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.459910 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.459885 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-secret-telemeter-client\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.460636 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.460615 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d86b1a22-e16a-4495-b0ec-839c281c17af-telemeter-client-tls\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.466522 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.466498 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg4s8\" (UniqueName: \"kubernetes.io/projected/d86b1a22-e16a-4495-b0ec-839c281c17af-kube-api-access-dg4s8\") pod \"telemeter-client-579fff4bc7-jfs4h\" (UID: \"d86b1a22-e16a-4495-b0ec-839c281c17af\") " pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.573102 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.573051 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" Sep 19 01:42:29.856638 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:29.856546 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-579fff4bc7-jfs4h"] Sep 19 01:42:29.862766 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:42:29.862737 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86b1a22_e16a_4495_b0ec_839c281c17af.slice/crio-5b336c4835d1de99105f8cc6ca90dfe39b2f2f5a722eeb68cf1ecfca925dd2af WatchSource:0}: Error finding container 5b336c4835d1de99105f8cc6ca90dfe39b2f2f5a722eeb68cf1ecfca925dd2af: Status 404 returned error can't find the container with id 5b336c4835d1de99105f8cc6ca90dfe39b2f2f5a722eeb68cf1ecfca925dd2af Sep 19 01:42:30.371243 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:30.371209 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" event={"ID":"d86b1a22-e16a-4495-b0ec-839c281c17af","Type":"ContainerStarted","Data":"5b336c4835d1de99105f8cc6ca90dfe39b2f2f5a722eeb68cf1ecfca925dd2af"} Sep 19 01:42:32.384025 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.383992 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" event={"ID":"d86b1a22-e16a-4495-b0ec-839c281c17af","Type":"ContainerStarted","Data":"0026afb0253e25cedfeb3f326215a0845f27aa8e599327248f5187e660709c0c"} Sep 19 01:42:32.384386 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.384049 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" event={"ID":"d86b1a22-e16a-4495-b0ec-839c281c17af","Type":"ContainerStarted","Data":"b0bcfd68e8600dbb3465ed34912f3571de9277d7c08fbcf35d918add7eec3951"} Sep 19 01:42:32.384386 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.384067 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" event={"ID":"d86b1a22-e16a-4495-b0ec-839c281c17af","Type":"ContainerStarted","Data":"7ff44e8d7f236e00393ba2b97ef860a0444411ed2f321083fcf2acf2591c16f8"} Sep 19 01:42:32.422763 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.422714 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-579fff4bc7-jfs4h" podStartSLOduration=1.636247813 podStartE2EDuration="3.422699004s" totalImagesPullingTime="1.786451191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:42:32.420521768 +0000 UTC m=+192.153260021" watchObservedRunningTime="2026-09-19 01:42:32.422699004 +0000 UTC m=+192.155437257" Sep 19 01:42:32.540767 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.540739 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67cc7b568b-5r5km"] Sep 19 01:42:32.543944 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.543922 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.565484 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.565454 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67cc7b568b-5r5km"] Sep 19 01:42:32.584520 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.584494 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpdqf\" (UniqueName: \"kubernetes.io/projected/13b1805c-5ec7-4a7e-9453-c31f9e034246-kube-api-access-fpdqf\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.584653 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.584558 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-service-ca\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.584717 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.584692 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-trusted-ca-bundle\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.584768 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.584753 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-oauth-serving-cert\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.584807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.584795 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-serving-cert\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.584837 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.584816 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-oauth-config\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.584837 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.584832 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-config\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.615686 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.615654 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:42:32.686212 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686156 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-trusted-ca-bundle\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.686212 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686192 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-oauth-serving-cert\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.686363 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686216 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-serving-cert\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.686363 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686232 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-oauth-config\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.686363 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686248 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-config\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.686363 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686274 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpdqf\" (UniqueName: \"kubernetes.io/projected/13b1805c-5ec7-4a7e-9453-c31f9e034246-kube-api-access-fpdqf\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.686363 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686332 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-service-ca\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.686982 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.686964 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-oauth-serving-cert\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.687092 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.687077 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-service-ca\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.687243 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.687223 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-config\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.687439 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.687419 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-trusted-ca-bundle\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.688942 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.688923 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-oauth-config\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.688986 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.688955 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-serving-cert\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.695180 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.695160 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpdqf\" (UniqueName: \"kubernetes.io/projected/13b1805c-5ec7-4a7e-9453-c31f9e034246-kube-api-access-fpdqf\") pod \"console-67cc7b568b-5r5km\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:32.713317 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.713291 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:42:32.853115 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:32.853092 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:33.130192 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:33.130149 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67cc7b568b-5r5km"] Sep 19 01:42:33.133077 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:42:33.133049 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b1805c_5ec7_4a7e_9453_c31f9e034246.slice/crio-76541eb4f6ff8382edffe4bd0a9046edb5b4bacd3c674287e2fdfd7aedab0b29 WatchSource:0}: Error finding container 76541eb4f6ff8382edffe4bd0a9046edb5b4bacd3c674287e2fdfd7aedab0b29: Status 404 returned error can't find the container with id 76541eb4f6ff8382edffe4bd0a9046edb5b4bacd3c674287e2fdfd7aedab0b29 Sep 19 01:42:33.389638 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:33.389537 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67cc7b568b-5r5km" event={"ID":"13b1805c-5ec7-4a7e-9453-c31f9e034246","Type":"ContainerStarted","Data":"32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46"} Sep 19 01:42:33.389638 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:33.389617 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67cc7b568b-5r5km" event={"ID":"13b1805c-5ec7-4a7e-9453-c31f9e034246","Type":"ContainerStarted","Data":"76541eb4f6ff8382edffe4bd0a9046edb5b4bacd3c674287e2fdfd7aedab0b29"} Sep 19 01:42:33.425380 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:33.425336 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67cc7b568b-5r5km" podStartSLOduration=1.42532105 podStartE2EDuration="1.42532105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:42:33.424916311 +0000 UTC m=+193.157654565" watchObservedRunningTime="2026-09-19 01:42:33.42532105 +0000 UTC m=+193.158059303" Sep 19 01:42:42.853415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:42.853380 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:42.853801 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:42.853435 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:42.858191 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:42.858167 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:43.439415 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:43.439385 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:42:43.526144 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:43.526108 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754b9fd98f-vvcl5"] Sep 19 01:42:43.765106 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:43.765009 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:42:43.876812 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:42:43.876785 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:08.545865 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.545820 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-754b9fd98f-vvcl5" podUID="08b0dad6-0497-4f0f-b894-143e6d1d83a9" containerName="console" containerID="cri-o://4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db" gracePeriod=15 Sep 19 01:43:08.790651 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.790622 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:43:08.965713 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.965688 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-service-ca\") pod \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " Sep 19 01:43:08.965882 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.965738 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-serving-cert\") pod \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " Sep 19 01:43:08.965882 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.965766 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-oauth-serving-cert\") pod \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " Sep 19 01:43:08.965986 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.965960 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-oauth-config\") pod \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " Sep 19 01:43:08.966046 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966018 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-config\") pod \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " Sep 19 01:43:08.966101 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966058 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkn5h\" (UniqueName: \"kubernetes.io/projected/08b0dad6-0497-4f0f-b894-143e6d1d83a9-kube-api-access-hkn5h\") pod \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " Sep 19 01:43:08.966155 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966117 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-trusted-ca-bundle\") pod \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\" (UID: \"08b0dad6-0497-4f0f-b894-143e6d1d83a9\") " Sep 19 01:43:08.966208 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966148 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08b0dad6-0497-4f0f-b894-143e6d1d83a9" (UID: "08b0dad6-0497-4f0f-b894-143e6d1d83a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:43:08.966208 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966157 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "08b0dad6-0497-4f0f-b894-143e6d1d83a9" (UID: "08b0dad6-0497-4f0f-b894-143e6d1d83a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:43:08.966404 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966382 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-service-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:43:08.966528 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966409 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-oauth-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:43:08.966699 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966680 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "08b0dad6-0497-4f0f-b894-143e6d1d83a9" (UID: "08b0dad6-0497-4f0f-b894-143e6d1d83a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:43:08.966699 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.966678 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-config" (OuterVolumeSpecName: "console-config") pod "08b0dad6-0497-4f0f-b894-143e6d1d83a9" (UID: "08b0dad6-0497-4f0f-b894-143e6d1d83a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:43:08.968208 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.968187 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08b0dad6-0497-4f0f-b894-143e6d1d83a9" (UID: "08b0dad6-0497-4f0f-b894-143e6d1d83a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:43:08.968292 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.968235 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08b0dad6-0497-4f0f-b894-143e6d1d83a9" (UID: "08b0dad6-0497-4f0f-b894-143e6d1d83a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:43:08.968292 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:08.968249 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b0dad6-0497-4f0f-b894-143e6d1d83a9-kube-api-access-hkn5h" (OuterVolumeSpecName: "kube-api-access-hkn5h") pod "08b0dad6-0497-4f0f-b894-143e6d1d83a9" (UID: "08b0dad6-0497-4f0f-b894-143e6d1d83a9"). InnerVolumeSpecName "kube-api-access-hkn5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:43:09.067778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.067739 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-trusted-ca-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:43:09.067778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.067775 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:43:09.067778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.067784 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-oauth-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:43:09.067959 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.067793 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0dad6-0497-4f0f-b894-143e6d1d83a9-console-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:43:09.067959 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.067802 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkn5h\" (UniqueName: \"kubernetes.io/projected/08b0dad6-0497-4f0f-b894-143e6d1d83a9-kube-api-access-hkn5h\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:43:09.544352 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.544317 2587 generic.go:356] "Generic (PLEG): container finished" podID="08b0dad6-0497-4f0f-b894-143e6d1d83a9" containerID="4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db" exitCode=0 Sep 19 01:43:09.544512 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.544366 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b9fd98f-vvcl5" Sep 19 01:43:09.544512 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.544398 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b9fd98f-vvcl5" event={"ID":"08b0dad6-0497-4f0f-b894-143e6d1d83a9","Type":"ContainerDied","Data":"4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db"} Sep 19 01:43:09.544512 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.544445 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b9fd98f-vvcl5" event={"ID":"08b0dad6-0497-4f0f-b894-143e6d1d83a9","Type":"ContainerDied","Data":"19d8ddad45fbd78b84a5a913c685e2b403888b0f7367589c5294788003d03244"} Sep 19 01:43:09.544512 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.544465 2587 scope.go:117] "RemoveContainer" containerID="4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db" Sep 19 01:43:09.553549 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.553397 2587 scope.go:117] "RemoveContainer" containerID="4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db" Sep 19 01:43:09.553845 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:43:09.553782 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db\": container with ID starting with 4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db not found: ID does not exist" containerID="4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db" Sep 19 01:43:09.553845 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.553803 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db"} err="failed to get container status \"4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db\": rpc error: code = NotFound desc = could not find container \"4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db\": container with ID starting with 4947587ea24907ffeaa9c7918ba4103c61a0e6d8663f3284319a1a32230234db not found: ID does not exist" Sep 19 01:43:09.566626 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.566603 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754b9fd98f-vvcl5"] Sep 19 01:43:09.568033 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:09.568015 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-754b9fd98f-vvcl5"] Sep 19 01:43:10.515752 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:10.515717 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b0dad6-0497-4f0f-b894-143e6d1d83a9" path="/var/lib/kubelet/pods/08b0dad6-0497-4f0f-b894-143e6d1d83a9/volumes" Sep 19 01:43:14.374285 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:14.374250 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:14.471655 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:14.471622 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:34.314022 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:34.313943 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:39.413874 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.413841 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:39.511464 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.511431 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:39.888026 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.887992 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5b5bfb54-d24r7"] Sep 19 01:43:39.888343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.888329 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b0dad6-0497-4f0f-b894-143e6d1d83a9" containerName="console" Sep 19 01:43:39.888390 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.888344 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b0dad6-0497-4f0f-b894-143e6d1d83a9" containerName="console" Sep 19 01:43:39.888430 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.888393 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b0dad6-0497-4f0f-b894-143e6d1d83a9" containerName="console" Sep 19 01:43:39.891617 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.891594 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:39.906626 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.906603 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5b5bfb54-d24r7"] Sep 19 01:43:39.962000 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.961970 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:39.996084 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.996045 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvb6\" (UniqueName: \"kubernetes.io/projected/067c822b-9b54-4e8f-94bc-97e5b8e227df-kube-api-access-8pvb6\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:39.996201 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.996092 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-serving-cert\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:39.996201 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.996116 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-oauth-config\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:39.996201 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.996186 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-config\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:39.996362 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.996253 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-oauth-serving-cert\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:39.996362 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.996323 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-trusted-ca-bundle\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:39.996458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:39.996367 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-service-ca\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.031921 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.031896 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:40.094935 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.094907 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:40.097040 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097024 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-trusted-ca-bundle\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.097125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097054 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-service-ca\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.097125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097090 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvb6\" (UniqueName: \"kubernetes.io/projected/067c822b-9b54-4e8f-94bc-97e5b8e227df-kube-api-access-8pvb6\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.097125 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097109 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-serving-cert\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.097274 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097209 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-oauth-config\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.097274 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097253 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-config\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.097376 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097303 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-oauth-serving-cert\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.097847 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.097826 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-service-ca\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.098035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.098019 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-config\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.098189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.098167 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-oauth-serving-cert\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.098235 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.098185 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-trusted-ca-bundle\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.099815 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.099794 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-oauth-config\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.099955 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.099938 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-serving-cert\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.108244 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.108206 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvb6\" (UniqueName: \"kubernetes.io/projected/067c822b-9b54-4e8f-94bc-97e5b8e227df-kube-api-access-8pvb6\") pod \"console-7f5b5bfb54-d24r7\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.200409 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.200372 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:40.476340 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.476310 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5b5bfb54-d24r7"] Sep 19 01:43:40.477634 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:43:40.477608 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067c822b_9b54_4e8f_94bc_97e5b8e227df.slice/crio-fb22aaaab6323b2db883a2b7e1c997a3df6dbd1c75c0cee9d93a583426274e06 WatchSource:0}: Error finding container fb22aaaab6323b2db883a2b7e1c997a3df6dbd1c75c0cee9d93a583426274e06: Status 404 returned error can't find the container with id fb22aaaab6323b2db883a2b7e1c997a3df6dbd1c75c0cee9d93a583426274e06 Sep 19 01:43:40.672154 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.672034 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b5bfb54-d24r7" event={"ID":"067c822b-9b54-4e8f-94bc-97e5b8e227df","Type":"ContainerStarted","Data":"36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08"} Sep 19 01:43:40.672154 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.672098 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b5bfb54-d24r7" event={"ID":"067c822b-9b54-4e8f-94bc-97e5b8e227df","Type":"ContainerStarted","Data":"fb22aaaab6323b2db883a2b7e1c997a3df6dbd1c75c0cee9d93a583426274e06"} Sep 19 01:43:40.692545 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.692495 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5b5bfb54-d24r7" podStartSLOduration=1.6924792709999998 podStartE2EDuration="1.692479271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:43:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:43:40.691606759 +0000 UTC m=+260.424345014" watchObservedRunningTime="2026-09-19 01:43:40.692479271 +0000 UTC m=+260.425217523" Sep 19 01:43:40.699122 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.699091 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:40.760024 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:40.759959 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:50.201060 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:50.201024 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:50.201446 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:50.201085 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:50.205795 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:50.205771 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:50.717805 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:50.717781 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:43:50.765444 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:50.765411 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67cc7b568b-5r5km"] Sep 19 01:43:50.883015 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:50.882983 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:50.983664 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:50.983594 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:51.084635 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:51.084608 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:51.461755 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:51.461722 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:43:51.524364 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:43:51.524336 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:44:01.058788 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:01.058745 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:44:01.161555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:01.161485 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:44:15.791475 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:15.791416 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67cc7b568b-5r5km" podUID="13b1805c-5ec7-4a7e-9453-c31f9e034246" containerName="console" containerID="cri-o://32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46" gracePeriod=15 Sep 19 01:44:16.030520 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.030497 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:44:16.079533 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079454 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-config\") pod \"13b1805c-5ec7-4a7e-9453-c31f9e034246\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " Sep 19 01:44:16.079533 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079496 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-oauth-config\") pod \"13b1805c-5ec7-4a7e-9453-c31f9e034246\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " Sep 19 01:44:16.079750 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079537 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-serving-cert\") pod \"13b1805c-5ec7-4a7e-9453-c31f9e034246\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " Sep 19 01:44:16.079750 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079597 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-service-ca\") pod \"13b1805c-5ec7-4a7e-9453-c31f9e034246\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " Sep 19 01:44:16.079750 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079635 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpdqf\" (UniqueName: \"kubernetes.io/projected/13b1805c-5ec7-4a7e-9453-c31f9e034246-kube-api-access-fpdqf\") pod \"13b1805c-5ec7-4a7e-9453-c31f9e034246\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " Sep 19 01:44:16.079750 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079663 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-oauth-serving-cert\") pod \"13b1805c-5ec7-4a7e-9453-c31f9e034246\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " Sep 19 01:44:16.079750 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079701 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-trusted-ca-bundle\") pod \"13b1805c-5ec7-4a7e-9453-c31f9e034246\" (UID: \"13b1805c-5ec7-4a7e-9453-c31f9e034246\") " Sep 19 01:44:16.079999 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.079844 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-config" (OuterVolumeSpecName: "console-config") pod "13b1805c-5ec7-4a7e-9453-c31f9e034246" (UID: "13b1805c-5ec7-4a7e-9453-c31f9e034246"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:44:16.080074 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.080054 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:44:16.080189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.080161 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "13b1805c-5ec7-4a7e-9453-c31f9e034246" (UID: "13b1805c-5ec7-4a7e-9453-c31f9e034246"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:44:16.080249 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.080165 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "13b1805c-5ec7-4a7e-9453-c31f9e034246" (UID: "13b1805c-5ec7-4a7e-9453-c31f9e034246"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:44:16.080249 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.080232 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-service-ca" (OuterVolumeSpecName: "service-ca") pod "13b1805c-5ec7-4a7e-9453-c31f9e034246" (UID: "13b1805c-5ec7-4a7e-9453-c31f9e034246"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:44:16.082035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.082008 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "13b1805c-5ec7-4a7e-9453-c31f9e034246" (UID: "13b1805c-5ec7-4a7e-9453-c31f9e034246"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:44:16.082455 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.082432 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "13b1805c-5ec7-4a7e-9453-c31f9e034246" (UID: "13b1805c-5ec7-4a7e-9453-c31f9e034246"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:44:16.082455 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.082433 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b1805c-5ec7-4a7e-9453-c31f9e034246-kube-api-access-fpdqf" (OuterVolumeSpecName: "kube-api-access-fpdqf") pod "13b1805c-5ec7-4a7e-9453-c31f9e034246" (UID: "13b1805c-5ec7-4a7e-9453-c31f9e034246"). InnerVolumeSpecName "kube-api-access-fpdqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:44:16.180863 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.180827 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:44:16.180863 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.180860 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-service-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:44:16.180863 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.180869 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpdqf\" (UniqueName: \"kubernetes.io/projected/13b1805c-5ec7-4a7e-9453-c31f9e034246-kube-api-access-fpdqf\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:44:16.181033 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.180879 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-oauth-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:44:16.181033 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.180887 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13b1805c-5ec7-4a7e-9453-c31f9e034246-trusted-ca-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:44:16.181033 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.180895 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13b1805c-5ec7-4a7e-9453-c31f9e034246-console-oauth-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:44:16.819771 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.819681 2587 generic.go:356] "Generic (PLEG): container finished" podID="13b1805c-5ec7-4a7e-9453-c31f9e034246" containerID="32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46" exitCode=0 Sep 19 01:44:16.819771 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.819729 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67cc7b568b-5r5km" Sep 19 01:44:16.819771 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.819739 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67cc7b568b-5r5km" event={"ID":"13b1805c-5ec7-4a7e-9453-c31f9e034246","Type":"ContainerDied","Data":"32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46"} Sep 19 01:44:16.820235 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.819787 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67cc7b568b-5r5km" event={"ID":"13b1805c-5ec7-4a7e-9453-c31f9e034246","Type":"ContainerDied","Data":"76541eb4f6ff8382edffe4bd0a9046edb5b4bacd3c674287e2fdfd7aedab0b29"} Sep 19 01:44:16.820235 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.819813 2587 scope.go:117] "RemoveContainer" containerID="32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46" Sep 19 01:44:16.828335 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.828318 2587 scope.go:117] "RemoveContainer" containerID="32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46" Sep 19 01:44:16.828645 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:44:16.828623 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46\": container with ID starting with 32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46 not found: ID does not exist" containerID="32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46" Sep 19 01:44:16.828711 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.828655 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46"} err="failed to get container status \"32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46\": rpc error: code = NotFound desc = could not find container \"32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46\": container with ID starting with 32b71465c925939be25fa987c2eec99c7040296377a0dff6dc5ce490e9f3ca46 not found: ID does not exist" Sep 19 01:44:16.838151 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.838126 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67cc7b568b-5r5km"] Sep 19 01:44:16.841218 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:16.841198 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67cc7b568b-5r5km"] Sep 19 01:44:18.515292 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:18.515262 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13b1805c-5ec7-4a7e-9453-c31f9e034246" path="/var/lib/kubelet/pods/13b1805c-5ec7-4a7e-9453-c31f9e034246/volumes" Sep 19 01:44:22.388100 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:22.388073 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:44:22.390994 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:22.390972 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:44:22.391137 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:22.391088 2587 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 01:44:38.770131 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:38.770096 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:44:40.365916 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:44:40.365882 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:00.908861 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:00.908824 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:01.356923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:01.356865 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:05.157844 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:05.157812 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:05.293493 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:05.293464 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:06.811035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:06.811004 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:06.968605 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:06.968548 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:07.167458 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.167381 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xdtkc"] Sep 19 01:45:07.167762 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.167748 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b1805c-5ec7-4a7e-9453-c31f9e034246" containerName="console" Sep 19 01:45:07.167814 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.167764 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b1805c-5ec7-4a7e-9453-c31f9e034246" containerName="console" Sep 19 01:45:07.167852 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.167821 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="13b1805c-5ec7-4a7e-9453-c31f9e034246" containerName="console" Sep 19 01:45:07.170592 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.170562 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.176138 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.176118 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 19 01:45:07.176268 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.176165 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 19 01:45:07.199990 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.199958 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xdtkc"] Sep 19 01:45:07.239436 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.239393 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1c6499-6ca2-4d74-9f92-e5437abb7688-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xdtkc\" (UID: \"7e1c6499-6ca2-4d74-9f92-e5437abb7688\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.239619 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.239507 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp5nt\" (UniqueName: \"kubernetes.io/projected/7e1c6499-6ca2-4d74-9f92-e5437abb7688-kube-api-access-qp5nt\") pod \"cert-manager-webhook-6486ffd997-xdtkc\" (UID: \"7e1c6499-6ca2-4d74-9f92-e5437abb7688\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.340375 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.340346 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp5nt\" (UniqueName: \"kubernetes.io/projected/7e1c6499-6ca2-4d74-9f92-e5437abb7688-kube-api-access-qp5nt\") pod \"cert-manager-webhook-6486ffd997-xdtkc\" (UID: \"7e1c6499-6ca2-4d74-9f92-e5437abb7688\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.340515 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.340407 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1c6499-6ca2-4d74-9f92-e5437abb7688-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xdtkc\" (UID: \"7e1c6499-6ca2-4d74-9f92-e5437abb7688\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.364544 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.364512 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp5nt\" (UniqueName: \"kubernetes.io/projected/7e1c6499-6ca2-4d74-9f92-e5437abb7688-kube-api-access-qp5nt\") pod \"cert-manager-webhook-6486ffd997-xdtkc\" (UID: \"7e1c6499-6ca2-4d74-9f92-e5437abb7688\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.368153 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.368131 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1c6499-6ca2-4d74-9f92-e5437abb7688-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xdtkc\" (UID: \"7e1c6499-6ca2-4d74-9f92-e5437abb7688\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.489897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.489877 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:07.772699 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.772583 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xdtkc"] Sep 19 01:45:07.774915 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:45:07.774886 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e1c6499_6ca2_4d74_9f92_e5437abb7688.slice/crio-1e051494b2b9bdcf8e7b77872b265c530f0b3ee1fa3f6fd82bf2ec8147bc1f5f WatchSource:0}: Error finding container 1e051494b2b9bdcf8e7b77872b265c530f0b3ee1fa3f6fd82bf2ec8147bc1f5f: Status 404 returned error can't find the container with id 1e051494b2b9bdcf8e7b77872b265c530f0b3ee1fa3f6fd82bf2ec8147bc1f5f Sep 19 01:45:07.776681 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:07.776662 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:45:08.030156 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:08.030083 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" event={"ID":"7e1c6499-6ca2-4d74-9f92-e5437abb7688","Type":"ContainerStarted","Data":"1e051494b2b9bdcf8e7b77872b265c530f0b3ee1fa3f6fd82bf2ec8147bc1f5f"} Sep 19 01:45:09.077856 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:09.077816 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:09.618266 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:09.618234 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:11.049436 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:11.049395 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" event={"ID":"7e1c6499-6ca2-4d74-9f92-e5437abb7688","Type":"ContainerStarted","Data":"7892e3095274abfdfe3ba618de6d15325f2221db4e8181d4fe8e53522e4e7b0d"} Sep 19 01:45:11.049833 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:11.049527 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:11.078362 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:11.078314 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" podStartSLOduration=0.957350893 podStartE2EDuration="4.078301074s" totalImagesPullingTime="3.120950181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:11.077824612 +0000 UTC m=+350.810562866" watchObservedRunningTime="2026-09-19 01:45:11.078301074 +0000 UTC m=+350.811039327" Sep 19 01:45:11.905539 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:11.905481 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:12.004478 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:12.004443 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:14.795335 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:14.795306 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:14.908242 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:14.908210 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:16.789755 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:16.789715 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:17.055146 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:17.055068 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xdtkc" Sep 19 01:45:19.007587 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:19.007527 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:19.107075 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:19.107047 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:24.246885 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:24.246838 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:24.423788 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:24.423754 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:26.519961 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:26.519919 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:27.681160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:27.681106 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:42.141110 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:42.141063 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:42.238044 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:42.238011 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:42.742840 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:42.742799 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:42.986465 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:42.986432 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:43.087342 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.087249 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:43.144191 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.144161 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm"] Sep 19 01:45:43.147608 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.147591 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.158309 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.158288 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 19 01:45:43.158429 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.158327 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 19 01:45:43.159250 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.159232 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hlcdh\"" Sep 19 01:45:43.159344 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.159273 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 19 01:45:43.166986 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.166969 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 19 01:45:43.273011 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.272980 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm"] Sep 19 01:45:43.327379 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.327351 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/67c63f3a-dc27-44ac-a904-9e915e0feefe-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.327379 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.327381 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67c63f3a-dc27-44ac-a904-9e915e0feefe-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.327553 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.327420 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/67c63f3a-dc27-44ac-a904-9e915e0feefe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.327553 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.327435 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67c63f3a-dc27-44ac-a904-9e915e0feefe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.327553 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.327496 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndnbs\" (UniqueName: \"kubernetes.io/projected/67c63f3a-dc27-44ac-a904-9e915e0feefe-kube-api-access-ndnbs\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.392166 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.392053 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:43.428762 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.428739 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/67c63f3a-dc27-44ac-a904-9e915e0feefe-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.428898 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.428770 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67c63f3a-dc27-44ac-a904-9e915e0feefe-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.428898 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.428835 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/67c63f3a-dc27-44ac-a904-9e915e0feefe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.428898 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.428864 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67c63f3a-dc27-44ac-a904-9e915e0feefe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.429073 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.428917 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndnbs\" (UniqueName: \"kubernetes.io/projected/67c63f3a-dc27-44ac-a904-9e915e0feefe-kube-api-access-ndnbs\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.429204 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.429179 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/67c63f3a-dc27-44ac-a904-9e915e0feefe-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.431626 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.431603 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67c63f3a-dc27-44ac-a904-9e915e0feefe-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.431780 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.431760 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/67c63f3a-dc27-44ac-a904-9e915e0feefe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.431918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.431900 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67c63f3a-dc27-44ac-a904-9e915e0feefe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.438276 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.438233 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndnbs\" (UniqueName: \"kubernetes.io/projected/67c63f3a-dc27-44ac-a904-9e915e0feefe-kube-api-access-ndnbs\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-rvpsm\" (UID: \"67c63f3a-dc27-44ac-a904-9e915e0feefe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.457248 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.457222 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:43.496987 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.496944 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:43.596207 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.596173 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:43.696516 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.696490 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:43.744251 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.744225 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm"] Sep 19 01:45:43.746908 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:45:43.746883 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c63f3a_dc27_44ac_a904_9e915e0feefe.slice/crio-9cab3017df26ef5c16fc5c93c5c0f5649bf02da2066fa1c7d59502b7fe396721 WatchSource:0}: Error finding container 9cab3017df26ef5c16fc5c93c5c0f5649bf02da2066fa1c7d59502b7fe396721: Status 404 returned error can't find the container with id 9cab3017df26ef5c16fc5c93c5c0f5649bf02da2066fa1c7d59502b7fe396721 Sep 19 01:45:43.799544 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.799496 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:43.900435 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:43.900406 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:44.009979 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:44.009908 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:44.102720 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:44.102671 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:44.188759 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:44.188726 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" event={"ID":"67c63f3a-dc27-44ac-a904-9e915e0feefe","Type":"ContainerStarted","Data":"9cab3017df26ef5c16fc5c93c5c0f5649bf02da2066fa1c7d59502b7fe396721"} Sep 19 01:45:47.208681 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:47.208644 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" event={"ID":"67c63f3a-dc27-44ac-a904-9e915e0feefe","Type":"ContainerStarted","Data":"82eaaa2f4fde30ecd0acdae037bf0d418effacb590d91152089d1c58cf244460"} Sep 19 01:45:48.214687 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:48.214655 2587 generic.go:356] "Generic (PLEG): container finished" podID="67c63f3a-dc27-44ac-a904-9e915e0feefe" containerID="82eaaa2f4fde30ecd0acdae037bf0d418effacb590d91152089d1c58cf244460" exitCode=0 Sep 19 01:45:48.215149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:48.214741 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" event={"ID":"67c63f3a-dc27-44ac-a904-9e915e0feefe","Type":"ContainerDied","Data":"82eaaa2f4fde30ecd0acdae037bf0d418effacb590d91152089d1c58cf244460"} Sep 19 01:45:49.221209 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:49.221173 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" event={"ID":"67c63f3a-dc27-44ac-a904-9e915e0feefe","Type":"ContainerStarted","Data":"03f9a447bc8ad496ae617934292156fae847088c4f3596ef0c389a7cf3c9070d"} Sep 19 01:45:49.221597 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:49.221272 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:45:49.250610 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:49.250521 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" podStartSLOduration=1.937959153 podStartE2EDuration="6.25046526s" totalImagesPullingTime="3.285971814s" totalInitContainerRuntime="1.026534293s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:49.2490733 +0000 UTC m=+388.981811555" watchObservedRunningTime="2026-09-19 01:45:49.25046526 +0000 UTC m=+388.983203600" Sep 19 01:45:55.131304 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:55.131269 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:55.300339 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:55.300304 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:58.004837 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.004798 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b596c78ff-85f24"] Sep 19 01:45:58.013587 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.013544 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.030714 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.030691 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b596c78ff-85f24"] Sep 19 01:45:58.055611 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.055560 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-serving-cert\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.055722 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.055616 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-oauth-config\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.055722 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.055635 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-service-ca\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.055722 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.055687 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-config\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.055722 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.055719 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-trusted-ca-bundle\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.055853 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.055733 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s66g7\" (UniqueName: \"kubernetes.io/projected/de03c284-c195-4360-a9a0-0e9c7f6e37f4-kube-api-access-s66g7\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.055853 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.055755 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-oauth-serving-cert\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.086294 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.086263 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:58.156662 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.156638 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-config\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.156753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.156667 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-trusted-ca-bundle\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.156753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.156684 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s66g7\" (UniqueName: \"kubernetes.io/projected/de03c284-c195-4360-a9a0-0e9c7f6e37f4-kube-api-access-s66g7\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.156753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.156699 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-oauth-serving-cert\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.156883 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.156761 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-serving-cert\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.156883 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.156785 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-oauth-config\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.156883 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.156810 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-service-ca\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.157546 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.157462 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-config\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.157546 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.157477 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-oauth-serving-cert\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.157546 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.157506 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-service-ca\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.157546 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.157632 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de03c284-c195-4360-a9a0-0e9c7f6e37f4-trusted-ca-bundle\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.159439 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.159406 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-serving-cert\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.159439 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.159426 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de03c284-c195-4360-a9a0-0e9c7f6e37f4-console-oauth-config\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.166152 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.166126 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s66g7\" (UniqueName: \"kubernetes.io/projected/de03c284-c195-4360-a9a0-0e9c7f6e37f4-kube-api-access-s66g7\") pod \"console-6b596c78ff-85f24\" (UID: \"de03c284-c195-4360-a9a0-0e9c7f6e37f4\") " pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.185403 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.185379 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:58.323168 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.323107 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:45:58.559694 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.559662 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:58.599366 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.599303 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b596c78ff-85f24"] Sep 19 01:45:58.602517 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:45:58.602490 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde03c284_c195_4360_a9a0_0e9c7f6e37f4.slice/crio-1ad6f7878b76640e64e298f060b1128f6b7c70d9637ba9360a9cc0c20a0bd6bc WatchSource:0}: Error finding container 1ad6f7878b76640e64e298f060b1128f6b7c70d9637ba9360a9cc0c20a0bd6bc: Status 404 returned error can't find the container with id 1ad6f7878b76640e64e298f060b1128f6b7c70d9637ba9360a9cc0c20a0bd6bc Sep 19 01:45:58.659619 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:58.659594 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:45:59.267406 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:59.267369 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b596c78ff-85f24" event={"ID":"de03c284-c195-4360-a9a0-0e9c7f6e37f4","Type":"ContainerStarted","Data":"a1e6cf90956c2830657cdcc549e3e52a26f0aeefd2b92777166e521e590bf53f"} Sep 19 01:45:59.267810 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:59.267420 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b596c78ff-85f24" event={"ID":"de03c284-c195-4360-a9a0-0e9c7f6e37f4","Type":"ContainerStarted","Data":"1ad6f7878b76640e64e298f060b1128f6b7c70d9637ba9360a9cc0c20a0bd6bc"} Sep 19 01:45:59.307032 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:45:59.306985 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b596c78ff-85f24" podStartSLOduration=2.306969611 podStartE2EDuration="2.306969611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:59.306901381 +0000 UTC m=+399.039639647" watchObservedRunningTime="2026-09-19 01:45:59.306969611 +0000 UTC m=+399.039707913" Sep 19 01:46:00.228283 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.228247 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-rvpsm" Sep 19 01:46:00.516434 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.516367 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz"] Sep 19 01:46:00.519862 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.519847 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.522906 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.522882 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:46:00.523105 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.523072 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 19 01:46:00.523217 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.523108 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w27lw\"" Sep 19 01:46:00.523217 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.523080 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 19 01:46:00.523217 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.523166 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 19 01:46:00.523401 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.523214 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 19 01:46:00.529207 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.529182 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz"] Sep 19 01:46:00.575136 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.575110 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a8162ce1-1c70-4573-8279-b54f786244b3-manager-config\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.575235 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.575137 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8162ce1-1c70-4573-8279-b54f786244b3-cert\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.575235 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.575156 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pr95\" (UniqueName: \"kubernetes.io/projected/a8162ce1-1c70-4573-8279-b54f786244b3-kube-api-access-7pr95\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.575532 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.575514 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8162ce1-1c70-4573-8279-b54f786244b3-metrics-cert\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.676319 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.676288 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8162ce1-1c70-4573-8279-b54f786244b3-metrics-cert\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.676448 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.676334 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a8162ce1-1c70-4573-8279-b54f786244b3-manager-config\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.676448 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.676404 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8162ce1-1c70-4573-8279-b54f786244b3-cert\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.676448 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.676443 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pr95\" (UniqueName: \"kubernetes.io/projected/a8162ce1-1c70-4573-8279-b54f786244b3-kube-api-access-7pr95\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.677098 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.677075 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a8162ce1-1c70-4573-8279-b54f786244b3-manager-config\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.679590 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.679542 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8162ce1-1c70-4573-8279-b54f786244b3-cert\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.679692 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.679550 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8162ce1-1c70-4573-8279-b54f786244b3-metrics-cert\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.685860 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.685830 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pr95\" (UniqueName: \"kubernetes.io/projected/a8162ce1-1c70-4573-8279-b54f786244b3-kube-api-access-7pr95\") pod \"lws-controller-manager-7fff7c5976-pz2hz\" (UID: \"a8162ce1-1c70-4573-8279-b54f786244b3\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:00.829735 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:00.829715 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:01.105432 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:01.105398 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz"] Sep 19 01:46:01.107870 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:46:01.107842 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8162ce1_1c70_4573_8279_b54f786244b3.slice/crio-f8a3c46780682e81cc1d57e7fa1a3c95ec68a1e770f17618606ce4c3a4ec927d WatchSource:0}: Error finding container f8a3c46780682e81cc1d57e7fa1a3c95ec68a1e770f17618606ce4c3a4ec927d: Status 404 returned error can't find the container with id f8a3c46780682e81cc1d57e7fa1a3c95ec68a1e770f17618606ce4c3a4ec927d Sep 19 01:46:01.277166 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:01.277138 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" event={"ID":"a8162ce1-1c70-4573-8279-b54f786244b3","Type":"ContainerStarted","Data":"f8a3c46780682e81cc1d57e7fa1a3c95ec68a1e770f17618606ce4c3a4ec927d"} Sep 19 01:46:03.576935 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:03.576887 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:03.764737 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:03.764706 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:03.975123 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:03.975091 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:04.296661 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:04.296627 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" event={"ID":"a8162ce1-1c70-4573-8279-b54f786244b3","Type":"ContainerStarted","Data":"ae2bb63f8c05bbd6b135683057707da89814c4d91e78673ef628799869d74ff2"} Sep 19 01:46:04.296846 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:04.296750 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:04.369135 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:04.369078 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" podStartSLOduration=1.650061557 podStartE2EDuration="4.369060586s" totalImagesPullingTime="2.718999029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:04.352160176 +0000 UTC m=+404.084898428" watchObservedRunningTime="2026-09-19 01:46:04.369060586 +0000 UTC m=+404.101798838" Sep 19 01:46:04.416600 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:04.416547 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:07.175825 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:07.175774 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:07.349440 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:07.349402 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:08.323940 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:08.323914 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:46:08.324288 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:08.323968 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:46:08.328493 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:08.328471 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:46:09.246428 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:09.246392 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:09.324634 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:09.324608 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b596c78ff-85f24" Sep 19 01:46:09.399479 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:09.399445 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5b5bfb54-d24r7"] Sep 19 01:46:09.573882 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:09.573800 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:09.670479 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:09.670439 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:09.734349 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:09.734301 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:11.458906 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.458869 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:11.530596 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.530539 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:11.755837 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.755750 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq"] Sep 19 01:46:11.759267 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.759248 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.762473 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.762446 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 19 01:46:11.762698 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.762684 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b4lkq\"" Sep 19 01:46:11.788299 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.788271 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq"] Sep 19 01:46:11.814174 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.814141 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:11.880601 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880552 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880748 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880614 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880748 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880639 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwgfs\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-kube-api-access-wwgfs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880748 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880719 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880855 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880750 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880855 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880776 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880855 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880848 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880944 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880875 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.880944 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.880895 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.918752 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.918715 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss"] Sep 19 01:46:11.922898 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.922882 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.939224 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.939201 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss"] Sep 19 01:46:11.942060 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.941687 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:11.982084 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982052 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982210 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982091 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982210 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982115 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnhh\" (UniqueName: \"kubernetes.io/projected/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-kube-api-access-8pnhh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982210 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982181 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982213 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982251 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982284 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982329 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982370 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982356 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982655 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982435 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982655 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982492 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982655 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982522 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982655 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982552 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwgfs\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-kube-api-access-wwgfs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982655 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982610 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982655 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982651 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982942 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982681 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:11.982942 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982693 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982942 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982752 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.982942 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.982827 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.983140 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.983039 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.983140 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.983039 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.983235 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.983142 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.983235 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.983194 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.984898 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.984875 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.985156 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.985140 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.995236 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.995209 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:11.995446 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:11.995426 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwgfs\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-kube-api-access-wwgfs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcld4qq\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:12.057178 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.057109 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:12.072161 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.072135 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:12.083440 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083420 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083455 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083538 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083510 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083685 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083539 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083685 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083592 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083685 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083654 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083853 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083687 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083853 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083716 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnhh\" (UniqueName: \"kubernetes.io/projected/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-kube-api-access-8pnhh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.083853 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083760 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.084139 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.083999 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.084139 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.084030 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.084307 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.084285 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.084660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.084634 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.084769 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.084660 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.086072 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.086049 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.086172 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.086155 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.093380 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.093360 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.093918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.093895 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnhh\" (UniqueName: \"kubernetes.io/projected/6a574d35-bc3b-4e21-bc38-24b7ceb327d0-kube-api-access-8pnhh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss\" (UID: \"6a574d35-bc3b-4e21-bc38-24b7ceb327d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.232517 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.232485 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:12.359729 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.359665 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq"] Sep 19 01:46:12.361900 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:46:12.361873 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2503fd_e57a_4d3a_8013_fe0717326bdf.slice/crio-1fe80891f3d1c7782f5c88a3fdf4f2cb9ad6812426da0651b0c164bca6db71e9 WatchSource:0}: Error finding container 1fe80891f3d1c7782f5c88a3fdf4f2cb9ad6812426da0651b0c164bca6db71e9: Status 404 returned error can't find the container with id 1fe80891f3d1c7782f5c88a3fdf4f2cb9ad6812426da0651b0c164bca6db71e9 Sep 19 01:46:12.505217 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:12.505121 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss"] Sep 19 01:46:12.507782 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:46:12.507751 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a574d35_bc3b_4e21_bc38_24b7ceb327d0.slice/crio-f253827d39b0920d38752c2c5af5e2d81aa40fb505a216d53f2ba3ed5e728877 WatchSource:0}: Error finding container f253827d39b0920d38752c2c5af5e2d81aa40fb505a216d53f2ba3ed5e728877: Status 404 returned error can't find the container with id f253827d39b0920d38752c2c5af5e2d81aa40fb505a216d53f2ba3ed5e728877 Sep 19 01:46:13.340160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:13.340122 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" event={"ID":"6a574d35-bc3b-4e21-bc38-24b7ceb327d0","Type":"ContainerStarted","Data":"f253827d39b0920d38752c2c5af5e2d81aa40fb505a216d53f2ba3ed5e728877"} Sep 19 01:46:13.341852 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:13.341740 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" event={"ID":"5a2503fd-e57a-4d3a-8013-fe0717326bdf","Type":"ContainerStarted","Data":"1fe80891f3d1c7782f5c88a3fdf4f2cb9ad6812426da0651b0c164bca6db71e9"} Sep 19 01:46:14.858797 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:14.858732 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:14.960679 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:14.960614 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:15.057088 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.057005 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:15.303618 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.303585 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-pz2hz" Sep 19 01:46:15.350436 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.350049 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:15.350436 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.350136 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:15.350436 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.350176 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:15.359674 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.359634 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:15.359778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.359716 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:15.359778 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.359762 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:15.495595 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.494839 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:15.639404 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.639301 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:15.762691 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:15.762660 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:16.372847 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:16.372807 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" event={"ID":"5a2503fd-e57a-4d3a-8013-fe0717326bdf","Type":"ContainerStarted","Data":"55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0"} Sep 19 01:46:16.374956 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:16.374926 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" event={"ID":"6a574d35-bc3b-4e21-bc38-24b7ceb327d0","Type":"ContainerStarted","Data":"f36d74ea4e04f10d5825f5a71ff3e692c8513e49491ede00bf111f177c49cf4b"} Sep 19 01:46:16.400639 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:16.400585 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" podStartSLOduration=2.414737798 podStartE2EDuration="5.400545716s" totalImagesPullingTime="2.985807918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:16.400227087 +0000 UTC m=+416.132965341" watchObservedRunningTime="2026-09-19 01:46:16.400545716 +0000 UTC m=+416.133283969" Sep 19 01:46:16.432804 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:16.432756 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" podStartSLOduration=2.58330589 podStartE2EDuration="5.43274249s" totalImagesPullingTime="2.8494366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:16.431886424 +0000 UTC m=+416.164624677" watchObservedRunningTime="2026-09-19 01:46:16.43274249 +0000 UTC m=+416.165480741" Sep 19 01:46:17.072659 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.072625 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:17.074100 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.074056 2587 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 19 01:46:17.074269 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.074121 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 19 01:46:17.233447 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.233420 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:17.238631 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.238606 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:17.381945 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.381862 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:17.382937 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.382915 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss" Sep 19 01:46:17.436362 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:17.436330 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq"] Sep 19 01:46:18.073521 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:18.073485 2587 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 19 01:46:18.073720 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:18.073550 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 19 01:46:19.073047 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:19.073005 2587 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 19 01:46:19.073509 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:19.073078 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 19 01:46:19.391087 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:19.390990 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerName="istio-proxy" containerID="cri-o://55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0" gracePeriod=30 Sep 19 01:46:21.875746 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.875712 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2"] Sep 19 01:46:21.887521 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.887495 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:21.890436 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.890414 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 19 01:46:21.890598 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.890422 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 19 01:46:21.890683 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.890668 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 19 01:46:21.890731 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.890697 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-th665\"" Sep 19 01:46:21.894788 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.894768 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2"] Sep 19 01:46:21.980881 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.980857 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:21.981035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.980885 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:21.981035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.980905 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:21.981035 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.980995 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:21.981162 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.981097 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:21.981162 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.981122 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:21.981259 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:21.981167 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9ksj\" (UniqueName: \"kubernetes.io/projected/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-kube-api-access-d9ksj\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.081883 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.081851 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.082077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.081925 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.082077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.081955 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.082077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.082000 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9ksj\" (UniqueName: \"kubernetes.io/projected/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-kube-api-access-d9ksj\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.082077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.082045 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.082077 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.082065 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.082329 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.082090 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.082824 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.082799 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.084621 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.084596 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.084711 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.084590 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.084939 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.084918 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.084995 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.084944 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.093937 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.093918 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.099059 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.099041 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9ksj\" (UniqueName: \"kubernetes.io/projected/d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9-kube-api-access-d9ksj\") pod \"istiod-openshift-gateway-5677ccb49b-nbbk2\" (UID: \"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.198372 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.198348 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:22.488115 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:22.488091 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2"] Sep 19 01:46:22.490018 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:46:22.489990 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b9727e_2b8c_44ca_82a0_a3fad4cfb9d9.slice/crio-079ce4a706d3bd3104299481a99646bf59c133c97f59dbef0ec931bf9c6a6be0 WatchSource:0}: Error finding container 079ce4a706d3bd3104299481a99646bf59c133c97f59dbef0ec931bf9c6a6be0: Status 404 returned error can't find the container with id 079ce4a706d3bd3104299481a99646bf59c133c97f59dbef0ec931bf9c6a6be0 Sep 19 01:46:23.411995 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:23.411950 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" event={"ID":"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9","Type":"ContainerStarted","Data":"079ce4a706d3bd3104299481a99646bf59c133c97f59dbef0ec931bf9c6a6be0"} Sep 19 01:46:25.100344 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.100299 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:25.100667 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.100395 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:46:25.195266 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.195235 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:25.316438 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316361 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-token\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316438 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316413 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-data\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316647 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316457 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-podinfo\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316647 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316541 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-credential-socket\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316647 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316591 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-certs\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316647 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316621 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istiod-ca-cert\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316791 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316659 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-envoy\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316791 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316677 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwgfs\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-kube-api-access-wwgfs\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.316791 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.316692 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-socket\") pod \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\" (UID: \"5a2503fd-e57a-4d3a-8013-fe0717326bdf\") " Sep 19 01:46:25.317850 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.317805 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:46:25.317850 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.317822 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:46:25.318047 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.317853 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:46:25.318336 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.318297 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:46:25.318336 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.318255 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:46:25.320432 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.320408 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:46:25.320526 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.320437 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:46:25.320526 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.320443 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 19 01:46:25.320776 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.320756 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-kube-api-access-wwgfs" (OuterVolumeSpecName: "kube-api-access-wwgfs") pod "5a2503fd-e57a-4d3a-8013-fe0717326bdf" (UID: "5a2503fd-e57a-4d3a-8013-fe0717326bdf"). InnerVolumeSpecName "kube-api-access-wwgfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:46:25.417449 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417417 2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-envoy\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417449 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417447 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwgfs\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-kube-api-access-wwgfs\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417458 2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-socket\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417466 2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-token\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417473 2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-data\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417480 2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istio-podinfo\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417487 2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-credential-socket\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417495 2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a2503fd-e57a-4d3a-8013-fe0717326bdf-workload-certs\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.417646 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.417503 2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a2503fd-e57a-4d3a-8013-fe0717326bdf-istiod-ca-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:25.425509 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.425294 2587 generic.go:356] "Generic (PLEG): container finished" podID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerID="55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0" exitCode=0 Sep 19 01:46:25.425509 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.425455 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" Sep 19 01:46:25.425799 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.425456 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" event={"ID":"5a2503fd-e57a-4d3a-8013-fe0717326bdf","Type":"ContainerDied","Data":"55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0"} Sep 19 01:46:25.425890 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.425848 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq" event={"ID":"5a2503fd-e57a-4d3a-8013-fe0717326bdf","Type":"ContainerDied","Data":"1fe80891f3d1c7782f5c88a3fdf4f2cb9ad6812426da0651b0c164bca6db71e9"} Sep 19 01:46:25.425954 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.425891 2587 scope.go:117] "RemoveContainer" containerID="55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0" Sep 19 01:46:25.430301 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.428949 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" event={"ID":"d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9","Type":"ContainerStarted","Data":"1bc9e3a990f05265e72c864f2cf1ac3839ac08c6d4f3101924ee8b5ea8b8897b"} Sep 19 01:46:25.430301 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.429117 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:25.438636 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.438616 2587 scope.go:117] "RemoveContainer" containerID="55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0" Sep 19 01:46:25.438999 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:46:25.438978 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0\": container with ID starting with 55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0 not found: ID does not exist" containerID="55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0" Sep 19 01:46:25.439083 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.439006 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0"} err="failed to get container status \"55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0\": rpc error: code = NotFound desc = could not find container \"55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0\": container with ID starting with 55f7822023157323f987844f9e4ceec3397971cbd647358c34c241ae9629d8a0 not found: ID does not exist" Sep 19 01:46:25.558717 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.558664 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" podStartSLOduration=1.951018835 podStartE2EDuration="4.558645062s" totalImagesPullingTime="2.607626227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:25.55122677 +0000 UTC m=+425.283965022" watchObservedRunningTime="2026-09-19 01:46:25.558645062 +0000 UTC m=+425.291383315" Sep 19 01:46:25.630611 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.630486 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:25.638623 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.638594 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq"] Sep 19 01:46:25.654817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.654773 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcld4qq"] Sep 19 01:46:25.898605 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:25.898511 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:26.092547 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:26.092517 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:26.289283 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:26.289241 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:26.414868 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:26.414832 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:26.437132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:26.437105 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbbk2" Sep 19 01:46:26.516216 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:26.516186 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" path="/var/lib/kubelet/pods/5a2503fd-e57a-4d3a-8013-fe0717326bdf/volumes" Sep 19 01:46:34.420453 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.420368 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f5b5bfb54-d24r7" podUID="067c822b-9b54-4e8f-94bc-97e5b8e227df" containerName="console" containerID="cri-o://36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08" gracePeriod=15 Sep 19 01:46:34.658427 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.658405 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:46:34.701456 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701432 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-service-ca\") pod \"067c822b-9b54-4e8f-94bc-97e5b8e227df\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " Sep 19 01:46:34.701614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701480 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-oauth-serving-cert\") pod \"067c822b-9b54-4e8f-94bc-97e5b8e227df\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " Sep 19 01:46:34.701614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701519 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pvb6\" (UniqueName: \"kubernetes.io/projected/067c822b-9b54-4e8f-94bc-97e5b8e227df-kube-api-access-8pvb6\") pod \"067c822b-9b54-4e8f-94bc-97e5b8e227df\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " Sep 19 01:46:34.701614 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701596 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-serving-cert\") pod \"067c822b-9b54-4e8f-94bc-97e5b8e227df\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " Sep 19 01:46:34.701773 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701624 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-config\") pod \"067c822b-9b54-4e8f-94bc-97e5b8e227df\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " Sep 19 01:46:34.701773 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701645 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-oauth-config\") pod \"067c822b-9b54-4e8f-94bc-97e5b8e227df\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " Sep 19 01:46:34.701773 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701675 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-trusted-ca-bundle\") pod \"067c822b-9b54-4e8f-94bc-97e5b8e227df\" (UID: \"067c822b-9b54-4e8f-94bc-97e5b8e227df\") " Sep 19 01:46:34.701927 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701859 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-service-ca" (OuterVolumeSpecName: "service-ca") pod "067c822b-9b54-4e8f-94bc-97e5b8e227df" (UID: "067c822b-9b54-4e8f-94bc-97e5b8e227df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:46:34.701927 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701895 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "067c822b-9b54-4e8f-94bc-97e5b8e227df" (UID: "067c822b-9b54-4e8f-94bc-97e5b8e227df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:46:34.702037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701969 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-service-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:34.702037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.701989 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-oauth-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:34.702237 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.702212 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "067c822b-9b54-4e8f-94bc-97e5b8e227df" (UID: "067c822b-9b54-4e8f-94bc-97e5b8e227df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:46:34.702314 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.702234 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-config" (OuterVolumeSpecName: "console-config") pod "067c822b-9b54-4e8f-94bc-97e5b8e227df" (UID: "067c822b-9b54-4e8f-94bc-97e5b8e227df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:46:34.704041 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.704015 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "067c822b-9b54-4e8f-94bc-97e5b8e227df" (UID: "067c822b-9b54-4e8f-94bc-97e5b8e227df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:46:34.704041 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.704025 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/067c822b-9b54-4e8f-94bc-97e5b8e227df-kube-api-access-8pvb6" (OuterVolumeSpecName: "kube-api-access-8pvb6") pod "067c822b-9b54-4e8f-94bc-97e5b8e227df" (UID: "067c822b-9b54-4e8f-94bc-97e5b8e227df"). InnerVolumeSpecName "kube-api-access-8pvb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:46:34.704294 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.704270 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "067c822b-9b54-4e8f-94bc-97e5b8e227df" (UID: "067c822b-9b54-4e8f-94bc-97e5b8e227df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:46:34.802604 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.802555 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pvb6\" (UniqueName: \"kubernetes.io/projected/067c822b-9b54-4e8f-94bc-97e5b8e227df-kube-api-access-8pvb6\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:34.802604 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.802599 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:34.802604 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.802609 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:34.802796 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.802617 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067c822b-9b54-4e8f-94bc-97e5b8e227df-console-oauth-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:34.802796 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:34.802625 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c822b-9b54-4e8f-94bc-97e5b8e227df-trusted-ca-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:46:35.479418 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.479379 2587 generic.go:356] "Generic (PLEG): container finished" podID="067c822b-9b54-4e8f-94bc-97e5b8e227df" containerID="36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08" exitCode=0 Sep 19 01:46:35.479904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.479437 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b5bfb54-d24r7" Sep 19 01:46:35.479904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.479472 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b5bfb54-d24r7" event={"ID":"067c822b-9b54-4e8f-94bc-97e5b8e227df","Type":"ContainerDied","Data":"36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08"} Sep 19 01:46:35.479904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.479587 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b5bfb54-d24r7" event={"ID":"067c822b-9b54-4e8f-94bc-97e5b8e227df","Type":"ContainerDied","Data":"fb22aaaab6323b2db883a2b7e1c997a3df6dbd1c75c0cee9d93a583426274e06"} Sep 19 01:46:35.479904 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.479621 2587 scope.go:117] "RemoveContainer" containerID="36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08" Sep 19 01:46:35.489027 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.489008 2587 scope.go:117] "RemoveContainer" containerID="36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08" Sep 19 01:46:35.489304 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:46:35.489286 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08\": container with ID starting with 36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08 not found: ID does not exist" containerID="36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08" Sep 19 01:46:35.489377 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.489311 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08"} err="failed to get container status \"36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08\": rpc error: code = NotFound desc = could not find container \"36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08\": container with ID starting with 36478729ce31eaaf3568b9337f47a90358c8a0f7c6b6efcd4ee6eeed7daa0f08 not found: ID does not exist" Sep 19 01:46:35.507193 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.507172 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5b5bfb54-d24r7"] Sep 19 01:46:35.524720 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:35.524699 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5b5bfb54-d24r7"] Sep 19 01:46:36.515737 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:36.515705 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="067c822b-9b54-4e8f-94bc-97e5b8e227df" path="/var/lib/kubelet/pods/067c822b-9b54-4e8f-94bc-97e5b8e227df/volumes" Sep 19 01:46:45.139690 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:45.139655 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:46:45.215211 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:46:45.215176 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:16.008028 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:16.007990 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:16.190248 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:16.190213 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:35.210802 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:35.210767 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:38.220734 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:38.220699 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:39.828584 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:39.828538 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:40.181529 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:40.181446 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:40.321000 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:40.320969 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:40.902426 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:40.902392 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:41.402777 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:41.402742 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:42.161405 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:42.161376 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:42.283687 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:42.283652 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:44.245618 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:44.245586 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:44.608101 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:44.608027 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:46.181056 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:46.181020 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:46.358892 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:46.358858 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:48.469060 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:48.469023 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:48.681670 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:48.681638 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:50.037482 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:50.037447 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:50.127533 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:50.127500 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:51.778302 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:51.778270 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:51.949305 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:51.949272 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:56.320911 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:56.320874 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:56.415311 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:56.415278 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:47:56.514526 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:47:56.514486 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:05.442417 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:05.442382 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:05.550049 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:05.550015 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:05.653377 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:05.653349 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:08.318783 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:08.318752 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:08.513695 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:08.513660 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:10.453534 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:10.453450 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:10.532470 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:10.532439 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:15.661837 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:15.661800 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:15.748149 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:15.748109 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:15.844293 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:15.844256 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:24.520522 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:24.520488 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:24.618014 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:24.617979 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:31.720913 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.720879 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv"] Sep 19 01:48:31.721454 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.721435 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerName="istio-proxy" Sep 19 01:48:31.721499 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.721458 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerName="istio-proxy" Sep 19 01:48:31.721499 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.721474 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="067c822b-9b54-4e8f-94bc-97e5b8e227df" containerName="console" Sep 19 01:48:31.721499 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.721482 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="067c822b-9b54-4e8f-94bc-97e5b8e227df" containerName="console" Sep 19 01:48:31.721643 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.721631 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="067c822b-9b54-4e8f-94bc-97e5b8e227df" containerName="console" Sep 19 01:48:31.721680 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.721645 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a2503fd-e57a-4d3a-8013-fe0717326bdf" containerName="istio-proxy" Sep 19 01:48:31.725070 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.725050 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.728227 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.728207 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rn6m7\"" Sep 19 01:48:31.742877 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.742855 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv"] Sep 19 01:48:31.752648 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.752561 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:31.775124 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775093 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775230 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775137 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775230 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775168 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775230 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775214 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775401 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775250 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775401 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775311 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775401 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775350 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgg5m\" (UniqueName: \"kubernetes.io/projected/70822c2d-6dd9-4bdd-9728-d6b5ee555787-kube-api-access-sgg5m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775404 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.775555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.775471 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.874127 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.874096 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:31.875997 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.875979 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876067 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876022 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876067 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876042 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgg5m\" (UniqueName: \"kubernetes.io/projected/70822c2d-6dd9-4bdd-9728-d6b5ee555787-kube-api-access-sgg5m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876174 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876073 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876231 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876168 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876288 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876240 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876288 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876280 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876411 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876311 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876411 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876345 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876411 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876400 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876605 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876582 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876698 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876676 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876784 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876769 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.876924 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.876904 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.878743 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.878721 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.878953 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.878935 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.884859 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.884837 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgg5m\" (UniqueName: \"kubernetes.io/projected/70822c2d-6dd9-4bdd-9728-d6b5ee555787-kube-api-access-sgg5m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:31.885262 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:31.885241 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70822c2d-6dd9-4bdd-9728-d6b5ee555787-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cb2cv\" (UID: \"70822c2d-6dd9-4bdd-9728-d6b5ee555787\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:32.035668 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:32.035591 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:32.311087 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:32.311040 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv"] Sep 19 01:48:32.313509 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:48:32.313480 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70822c2d_6dd9_4bdd_9728_d6b5ee555787.slice/crio-7bcc167e2f373c8db677cb0eb8a8dc4ea59a4a1629f229fb39077bd456066fdb WatchSource:0}: Error finding container 7bcc167e2f373c8db677cb0eb8a8dc4ea59a4a1629f229fb39077bd456066fdb: Status 404 returned error can't find the container with id 7bcc167e2f373c8db677cb0eb8a8dc4ea59a4a1629f229fb39077bd456066fdb Sep 19 01:48:32.315642 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:32.315600 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:48:32.315729 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:32.315676 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:48:32.315729 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:32.315710 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:48:33.032437 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:33.032399 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" event={"ID":"70822c2d-6dd9-4bdd-9728-d6b5ee555787","Type":"ContainerStarted","Data":"414884a98b71f03d32aab000bd8186656960e4e65656412084fef4219a5f271a"} Sep 19 01:48:33.032824 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:33.032503 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" event={"ID":"70822c2d-6dd9-4bdd-9728-d6b5ee555787","Type":"ContainerStarted","Data":"7bcc167e2f373c8db677cb0eb8a8dc4ea59a4a1629f229fb39077bd456066fdb"} Sep 19 01:48:33.035908 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:33.035888 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:33.037298 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:33.037268 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cb2cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Sep 19 01:48:33.037422 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:33.037313 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podUID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Sep 19 01:48:33.056751 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:33.056696 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podStartSLOduration=2.056683264 podStartE2EDuration="2.056683264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:33.05466627 +0000 UTC m=+552.787404529" watchObservedRunningTime="2026-09-19 01:48:33.056683264 +0000 UTC m=+552.789421517" Sep 19 01:48:34.032080 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:34.032046 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:34.039233 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:34.039214 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:34.150144 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:34.150109 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:34.225284 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:34.225259 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:34.904607 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:34.904551 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:35.005533 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:35.005503 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:35.041699 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:35.041677 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:35.042613 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:35.042594 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:48:39.692452 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:39.692415 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:39.791277 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:39.791240 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:43.166053 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:43.166023 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:43.234726 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:43.234698 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:55.322637 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:55.322605 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:55.605487 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:55.605419 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:48:55.872464 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:48:55.872385 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:07.662836 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:07.662801 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:07.977928 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:07.977892 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:08.097753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:08.097722 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:14.772707 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:14.772670 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:14.864739 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:14.864675 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:14.946306 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:14.946272 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:15.037042 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:15.036958 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:15.124860 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:15.124830 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:18.271900 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:18.271860 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:18.474812 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:18.474779 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:22.422205 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:22.422176 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:49:22.422668 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:22.422248 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:49:27.685328 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:27.685287 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:51.764630 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:51.764588 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:53.289356 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:53.289316 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:53.388793 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:53.388759 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:53.574189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:53.574100 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:53.669689 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:53.669657 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:54.189741 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:54.189706 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:49:54.325674 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:49:54.325642 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:50:02.904918 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:02.904886 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:50:02.987947 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:02.987908 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:50:05.042659 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.042605 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cb2cv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Sep 19 01:50:05.042995 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.042669 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podUID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Sep 19 01:50:05.475589 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.475539 2587 generic.go:356] "Generic (PLEG): container finished" podID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerID="414884a98b71f03d32aab000bd8186656960e4e65656412084fef4219a5f271a" exitCode=0 Sep 19 01:50:05.475750 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.475603 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" event={"ID":"70822c2d-6dd9-4bdd-9728-d6b5ee555787","Type":"ContainerDied","Data":"414884a98b71f03d32aab000bd8186656960e4e65656412084fef4219a5f271a"} Sep 19 01:50:05.475976 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.475962 2587 scope.go:117] "RemoveContainer" containerID="414884a98b71f03d32aab000bd8186656960e4e65656412084fef4219a5f271a" Sep 19 01:50:05.476957 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.476933 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:50:05.477051 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.477036 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:50:05.477089 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:05.477080 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892132Ki","pods":"250"} Sep 19 01:50:06.482817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:06.482779 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" event={"ID":"70822c2d-6dd9-4bdd-9728-d6b5ee555787","Type":"ContainerStarted","Data":"02b5d5141b06b6d2c9d8c6d0499055ed460a140eba11f3311b96d60b4ba23732"} Sep 19 01:50:07.036310 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:07.036274 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:50:07.036525 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:07.036498 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cb2cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Sep 19 01:50:07.036645 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:07.036601 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podUID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Sep 19 01:50:08.036431 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:08.036402 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cb2cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Sep 19 01:50:08.036841 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:08.036468 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podUID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Sep 19 01:50:09.036203 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:09.036167 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cb2cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Sep 19 01:50:09.036382 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:09.036222 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podUID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Sep 19 01:50:10.036189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:10.036151 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cb2cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Sep 19 01:50:10.036612 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:10.036217 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podUID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Sep 19 01:50:11.036998 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:11.036953 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cb2cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Sep 19 01:50:11.037371 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:11.037015 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" podUID="70822c2d-6dd9-4bdd-9728-d6b5ee555787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Sep 19 01:50:12.040442 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:12.040411 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:50:12.040868 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:12.040770 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:50:12.041588 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:12.041548 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cb2cv" Sep 19 01:50:19.309848 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.309813 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8"] Sep 19 01:50:19.312318 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.312301 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.316698 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.316674 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xrctz\"" Sep 19 01:50:19.316838 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.316732 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 19 01:50:19.316838 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.316757 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 19 01:50:19.316838 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.316770 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 19 01:50:19.328553 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.328532 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8"] Sep 19 01:50:19.348849 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.348828 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:50:19.387014 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.386988 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.387111 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.387040 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ad9d108-2578-4544-a6f9-a19b0567747e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.387111 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.387086 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcrqj\" (UniqueName: \"kubernetes.io/projected/1ad9d108-2578-4544-a6f9-a19b0567747e-kube-api-access-fcrqj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.387189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.387119 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.387189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.387139 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.387189 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.387178 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.487901 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.487873 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ad9d108-2578-4544-a6f9-a19b0567747e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.487905 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcrqj\" (UniqueName: \"kubernetes.io/projected/1ad9d108-2578-4544-a6f9-a19b0567747e-kube-api-access-fcrqj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.487946 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.487965 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.487985 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488191 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.488080 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488481 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.488463 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.488504 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.488555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.488522 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.490395 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.490369 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ad9d108-2578-4544-a6f9-a19b0567747e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.490714 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.490696 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ad9d108-2578-4544-a6f9-a19b0567747e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.496797 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.496777 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcrqj\" (UniqueName: \"kubernetes.io/projected/1ad9d108-2578-4544-a6f9-a19b0567747e-kube-api-access-fcrqj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8\" (UID: \"1ad9d108-2578-4544-a6f9-a19b0567747e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.623398 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.623324 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:19.899632 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.899607 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8"] Sep 19 01:50:19.901723 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:50:19.901694 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad9d108_2578_4544_a6f9_a19b0567747e.slice/crio-82582237e7bb83c07327fd892160580f0ac4bc6de0c2fd32396fd5ecf5bdb820 WatchSource:0}: Error finding container 82582237e7bb83c07327fd892160580f0ac4bc6de0c2fd32396fd5ecf5bdb820: Status 404 returned error can't find the container with id 82582237e7bb83c07327fd892160580f0ac4bc6de0c2fd32396fd5ecf5bdb820 Sep 19 01:50:19.903020 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:19.903001 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:50:20.551789 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:20.551754 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" event={"ID":"1ad9d108-2578-4544-a6f9-a19b0567747e","Type":"ContainerStarted","Data":"82582237e7bb83c07327fd892160580f0ac4bc6de0c2fd32396fd5ecf5bdb820"} Sep 19 01:50:21.558226 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:21.558194 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" event={"ID":"1ad9d108-2578-4544-a6f9-a19b0567747e","Type":"ContainerStarted","Data":"55c9204f688e8507b1e52cab4bba01719d67209d3d42dd697985d5e1fe9903b4"} Sep 19 01:50:21.589440 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:21.589388 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" podStartSLOduration=1.502224085 podStartE2EDuration="2.589373551s" totalImagesPullingTime="1.087149466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:50:21.588109332 +0000 UTC m=+661.320847585" watchObservedRunningTime="2026-09-19 01:50:21.589373551 +0000 UTC m=+661.322111805" Sep 19 01:50:29.624288 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:29.624254 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:29.624799 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:29.624310 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:29.636774 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:29.636752 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:30.610817 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:30.610786 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8" Sep 19 01:50:37.168517 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:37.168479 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:50:45.846930 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:45.846884 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:50:50.902910 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.902879 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2"] Sep 19 01:50:50.906612 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.906588 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:50.909388 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.909364 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 19 01:50:50.917683 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.917660 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2"] Sep 19 01:50:50.961897 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.961870 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:50.962017 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.961910 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:50.962017 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.961927 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:50.962122 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.962028 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66mm8\" (UniqueName: \"kubernetes.io/projected/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-kube-api-access-66mm8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:50.962122 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.962061 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:50.962122 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:50.962094 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.063486 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.063448 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mm8\" (UniqueName: \"kubernetes.io/projected/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-kube-api-access-66mm8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.063660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.063496 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.063660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.063526 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.063660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.063579 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.063660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.063635 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.063660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.063655 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.063984 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.063955 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.064160 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.064137 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.064236 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.064165 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.066194 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.066171 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.066321 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.066305 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.073100 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.073076 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66mm8\" (UniqueName: \"kubernetes.io/projected/c5ce6beb-67ab-47cc-9007-2c7eb5b584ba-kube-api-access-66mm8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qtr2\" (UID: \"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.108067 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.108038 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:50:51.217343 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.217309 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:50:51.506115 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.506089 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2"] Sep 19 01:50:51.508863 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:50:51.508835 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ce6beb_67ab_47cc_9007_2c7eb5b584ba.slice/crio-dad5737c3f09fe67a2a70416b81b133ae5ba68d407bbfcd6e54af8717872b5a7 WatchSource:0}: Error finding container dad5737c3f09fe67a2a70416b81b133ae5ba68d407bbfcd6e54af8717872b5a7: Status 404 returned error can't find the container with id dad5737c3f09fe67a2a70416b81b133ae5ba68d407bbfcd6e54af8717872b5a7 Sep 19 01:50:51.697036 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:51.697004 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" event={"ID":"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba","Type":"ContainerStarted","Data":"dad5737c3f09fe67a2a70416b81b133ae5ba68d407bbfcd6e54af8717872b5a7"} Sep 19 01:50:52.703840 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:52.703809 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" event={"ID":"c5ce6beb-67ab-47cc-9007-2c7eb5b584ba","Type":"ContainerStarted","Data":"4daed0764364c70335f23dae2ac39a8e9eb09e1357720dd91820cc9b3809ee4a"} Sep 19 01:50:52.727914 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:50:52.727870 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" podStartSLOduration=2.536942286 podStartE2EDuration="2.727854426s" totalImagesPullingTime="190.91214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:50:52.726658055 +0000 UTC m=+692.459396311" watchObservedRunningTime="2026-09-19 01:50:52.727854426 +0000 UTC m=+692.460592678" Sep 19 01:51:01.217939 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:01.217907 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:51:01.218331 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:01.218017 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:51:01.230526 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:01.230503 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:51:01.763317 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:01.763287 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qtr2" Sep 19 01:51:08.051282 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.051251 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt"] Sep 19 01:51:08.054753 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.054732 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.057642 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.057620 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 19 01:51:08.071121 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.071099 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt"] Sep 19 01:51:08.098194 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.098169 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:51:08.215276 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.215248 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.215439 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.215288 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f62740f-9190-42c7-bc87-92ea4772f1de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.215439 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.215314 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.215439 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.215415 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.215553 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.215531 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.215622 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.215562 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6s8x\" (UniqueName: \"kubernetes.io/projected/6f62740f-9190-42c7-bc87-92ea4772f1de-kube-api-access-t6s8x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316236 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316155 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316236 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316191 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6s8x\" (UniqueName: \"kubernetes.io/projected/6f62740f-9190-42c7-bc87-92ea4772f1de-kube-api-access-t6s8x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316236 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316223 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316433 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316338 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f62740f-9190-42c7-bc87-92ea4772f1de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316433 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316374 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316433 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316405 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316634 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316616 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316795 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316773 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.316860 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.316814 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.318737 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.318713 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f62740f-9190-42c7-bc87-92ea4772f1de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.319051 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.319035 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f62740f-9190-42c7-bc87-92ea4772f1de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.325611 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.325562 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6s8x\" (UniqueName: \"kubernetes.io/projected/6f62740f-9190-42c7-bc87-92ea4772f1de-kube-api-access-t6s8x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt\" (UID: \"6f62740f-9190-42c7-bc87-92ea4772f1de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.365247 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.365228 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:08.637508 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.637435 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt"] Sep 19 01:51:08.641071 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:51:08.641044 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f62740f_9190_42c7_bc87_92ea4772f1de.slice/crio-36a6d6d896caad5736f343b2b5175f00829105e8dac39a767db409c5c01d629d WatchSource:0}: Error finding container 36a6d6d896caad5736f343b2b5175f00829105e8dac39a767db409c5c01d629d: Status 404 returned error can't find the container with id 36a6d6d896caad5736f343b2b5175f00829105e8dac39a767db409c5c01d629d Sep 19 01:51:08.786457 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:08.786419 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" event={"ID":"6f62740f-9190-42c7-bc87-92ea4772f1de","Type":"ContainerStarted","Data":"36a6d6d896caad5736f343b2b5175f00829105e8dac39a767db409c5c01d629d"} Sep 19 01:51:09.793400 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:09.793361 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" event={"ID":"6f62740f-9190-42c7-bc87-92ea4772f1de","Type":"ContainerStarted","Data":"02e2a55e6c2fa4a0dc2733dc3de637eb94ce92cedc339f643ce733bb8cf88613"} Sep 19 01:51:09.818339 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:09.818275 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" podStartSLOduration=1.639514652 podStartE2EDuration="1.818253418s" totalImagesPullingTime="178.738766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:51:09.815960519 +0000 UTC m=+709.548698775" watchObservedRunningTime="2026-09-19 01:51:09.818253418 +0000 UTC m=+709.550991671" Sep 19 01:51:18.366341 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:18.366305 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:18.366934 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:18.366363 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:18.378677 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:18.378655 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:18.849037 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:18.849009 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt" Sep 19 01:51:25.537553 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:25.537522 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:51:42.763048 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:51:42.763013 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:52:49.798839 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:52:49.798762 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:52:49.900621 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:52:49.900589 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:52:54.908230 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:52:54.908198 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:53:28.583857 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:28.583825 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:53:30.451265 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.451229 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-zmjv6"] Sep 19 01:53:30.454846 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.454829 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:30.457674 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.457638 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 19 01:53:30.457807 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.457718 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-2mrnp\"" Sep 19 01:53:30.467238 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.467210 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-zmjv6"] Sep 19 01:53:30.536555 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.536524 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbz8\" (UniqueName: \"kubernetes.io/projected/9ceb82ae-7c8b-4ecc-a053-de8b8508ff06-kube-api-access-gxbz8\") pod \"ai-gateway-controller-65dd9b4479-zmjv6\" (UID: \"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:30.637419 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.637390 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbz8\" (UniqueName: \"kubernetes.io/projected/9ceb82ae-7c8b-4ecc-a053-de8b8508ff06-kube-api-access-gxbz8\") pod \"ai-gateway-controller-65dd9b4479-zmjv6\" (UID: \"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:30.646563 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.646542 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbz8\" (UniqueName: \"kubernetes.io/projected/9ceb82ae-7c8b-4ecc-a053-de8b8508ff06-kube-api-access-gxbz8\") pod \"ai-gateway-controller-65dd9b4479-zmjv6\" (UID: \"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:30.765728 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:30.765650 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:31.038895 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:31.038872 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-zmjv6"] Sep 19 01:53:31.041201 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:53:31.041173 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ceb82ae_7c8b_4ecc_a053_de8b8508ff06.slice/crio-2370293bad0c7344dbe592e7963bde30e549f5a1c452804054491a0df8f44370 WatchSource:0}: Error finding container 2370293bad0c7344dbe592e7963bde30e549f5a1c452804054491a0df8f44370: Status 404 returned error can't find the container with id 2370293bad0c7344dbe592e7963bde30e549f5a1c452804054491a0df8f44370 Sep 19 01:53:31.497032 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:31.496987 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" event={"ID":"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06","Type":"ContainerStarted","Data":"2370293bad0c7344dbe592e7963bde30e549f5a1c452804054491a0df8f44370"} Sep 19 01:53:33.507905 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:33.507871 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" event={"ID":"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06","Type":"ContainerStarted","Data":"16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da"} Sep 19 01:53:33.508270 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:33.507936 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:33.527138 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:33.527100 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" podStartSLOduration=1.396432149 podStartE2EDuration="3.527085779s" totalImagesPullingTime="2.13065363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:53:33.526018664 +0000 UTC m=+853.258756918" watchObservedRunningTime="2026-09-19 01:53:33.527085779 +0000 UTC m=+853.259824032" Sep 19 01:53:44.516437 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:44.516408 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:58.174051 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.174018 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-zmjv6"] Sep 19 01:53:58.174420 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.174207 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" podUID="9ceb82ae-7c8b-4ecc-a053-de8b8508ff06" containerName="manager" containerID="cri-o://16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da" gracePeriod=30 Sep 19 01:53:58.422939 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.422917 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:58.588591 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.588541 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxbz8\" (UniqueName: \"kubernetes.io/projected/9ceb82ae-7c8b-4ecc-a053-de8b8508ff06-kube-api-access-gxbz8\") pod \"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06\" (UID: \"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06\") " Sep 19 01:53:58.590854 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.590830 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ceb82ae-7c8b-4ecc-a053-de8b8508ff06-kube-api-access-gxbz8" (OuterVolumeSpecName: "kube-api-access-gxbz8") pod "9ceb82ae-7c8b-4ecc-a053-de8b8508ff06" (UID: "9ceb82ae-7c8b-4ecc-a053-de8b8508ff06"). InnerVolumeSpecName "kube-api-access-gxbz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:53:58.627512 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.627483 2587 generic.go:356] "Generic (PLEG): container finished" podID="9ceb82ae-7c8b-4ecc-a053-de8b8508ff06" containerID="16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da" exitCode=0 Sep 19 01:53:58.627660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.627529 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" Sep 19 01:53:58.627660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.627539 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" event={"ID":"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06","Type":"ContainerDied","Data":"16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da"} Sep 19 01:53:58.627660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.627622 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-zmjv6" event={"ID":"9ceb82ae-7c8b-4ecc-a053-de8b8508ff06","Type":"ContainerDied","Data":"2370293bad0c7344dbe592e7963bde30e549f5a1c452804054491a0df8f44370"} Sep 19 01:53:58.627660 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.627654 2587 scope.go:117] "RemoveContainer" containerID="16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da" Sep 19 01:53:58.637148 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.637133 2587 scope.go:117] "RemoveContainer" containerID="16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da" Sep 19 01:53:58.637399 ip-10-0-139-3 kubenswrapper[2587]: E0919 01:53:58.637381 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da\": container with ID starting with 16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da not found: ID does not exist" containerID="16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da" Sep 19 01:53:58.637450 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.637407 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da"} err="failed to get container status \"16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da\": rpc error: code = NotFound desc = could not find container \"16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da\": container with ID starting with 16b319946392ae66ce6807fd4facd11f8c7937d30807d6769bf5092d8ecb25da not found: ID does not exist" Sep 19 01:53:58.649501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.649474 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-zmjv6"] Sep 19 01:53:58.653736 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.653715 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-zmjv6"] Sep 19 01:53:58.690225 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.690198 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxbz8\" (UniqueName: \"kubernetes.io/projected/9ceb82ae-7c8b-4ecc-a053-de8b8508ff06-kube-api-access-gxbz8\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Sep 19 01:53:58.766450 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.766422 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:53:58.864735 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:58.864669 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:53:59.616466 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:59.616395 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:53:59.815230 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:53:59.815199 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:54:00.516501 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:00.516461 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ceb82ae-7c8b-4ecc-a053-de8b8508ff06" path="/var/lib/kubelet/pods/9ceb82ae-7c8b-4ecc-a053-de8b8508ff06/volumes" Sep 19 01:54:06.807985 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:06.807956 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-rvpsm_67c63f3a-dc27-44ac-a904-9e915e0feefe/copy-manifests/0.log" Sep 19 01:54:06.821311 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:06.821245 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-rvpsm_67c63f3a-dc27-44ac-a904-9e915e0feefe/manager/0.log" Sep 19 01:54:09.086406 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:09.086371 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss_6a574d35-bc3b-4e21-bc38-24b7ceb327d0/istio-proxy/0.log" Sep 19 01:54:09.205056 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:09.205020 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbbk2_d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9/discovery/0.log" Sep 19 01:54:09.532042 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:09.532016 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cb2cv_70822c2d-6dd9-4bdd-9728-d6b5ee555787/istio-proxy/1.log" Sep 19 01:54:09.868560 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:09.868492 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685cd8b794-rd4s4_560ad04e-389c-4f1b-8b47-0a93e69b04d8/router/0.log" Sep 19 01:54:10.235684 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:10.235658 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-b5rr8_1ad9d108-2578-4544-a6f9-a19b0567747e/main/0.log" Sep 19 01:54:10.580654 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:10.580538 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9qtr2_c5ce6beb-67ab-47cc-9007-2c7eb5b584ba/main/0.log" Sep 19 01:54:10.687208 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:10.687184 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7tcrt_6f62740f-9190-42c7-bc87-92ea4772f1de/main/0.log" Sep 19 01:54:11.914940 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:11.914899 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:54:12.018707 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:12.018674 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" limit=1024 Sep 19 01:54:14.875869 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:14.875842 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-49pw7_a7f09212-56af-47d0-b7eb-cfefcbb0d916/global-pull-secret-syncer/0.log" Sep 19 01:54:15.020305 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:15.020273 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b6k6z_f8ce8216-8b0d-4de5-a84f-b1443048bd71/konnectivity-agent/0.log" Sep 19 01:54:15.193073 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:15.193053 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-3.ec2.internal_f088be7bcf4050825a01ace946d9f0d0/haproxy/0.log" Sep 19 01:54:22.051796 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.051727 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8556a17-b2cc-4327-a59a-359ce9ed1aeb/alertmanager/0.log" Sep 19 01:54:22.080176 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.080152 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8556a17-b2cc-4327-a59a-359ce9ed1aeb/config-reloader/0.log" Sep 19 01:54:22.108594 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.108555 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8556a17-b2cc-4327-a59a-359ce9ed1aeb/kube-rbac-proxy-web/0.log" Sep 19 01:54:22.149969 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.149950 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8556a17-b2cc-4327-a59a-359ce9ed1aeb/kube-rbac-proxy/0.log" Sep 19 01:54:22.206767 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.206750 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8556a17-b2cc-4327-a59a-359ce9ed1aeb/kube-rbac-proxy-metric/0.log" Sep 19 01:54:22.236510 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.236496 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8556a17-b2cc-4327-a59a-359ce9ed1aeb/prom-label-proxy/0.log" Sep 19 01:54:22.264485 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.264469 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8556a17-b2cc-4327-a59a-359ce9ed1aeb/init-config-reloader/0.log" Sep 19 01:54:22.307067 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.307019 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-h9ks9_a607f451-c9cc-48e3-9820-38befc8ae26b/cluster-monitoring-operator/0.log" Sep 19 01:54:22.334658 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.334636 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-dfxmw_98bb7689-c5f0-4e51-83c1-737139ca4a53/kube-state-metrics/0.log" Sep 19 01:54:22.357888 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.357868 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-dfxmw_98bb7689-c5f0-4e51-83c1-737139ca4a53/kube-rbac-proxy-main/0.log" Sep 19 01:54:22.384821 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.384788 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-dfxmw_98bb7689-c5f0-4e51-83c1-737139ca4a53/kube-rbac-proxy-self/0.log" Sep 19 01:54:22.461992 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.461967 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:54:22.463314 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.463292 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gp6l_480be173-55c0-467c-a043-ced8a09f95d8/ovn-acl-logging/0.log" Sep 19 01:54:22.485003 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.484973 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pqh4_ac7cead6-dde6-42ad-ad5c-9e066d4a09ef/node-exporter/0.log" Sep 19 01:54:22.511245 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.511226 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pqh4_ac7cead6-dde6-42ad-ad5c-9e066d4a09ef/kube-rbac-proxy/0.log" Sep 19 01:54:22.536266 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.536232 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pqh4_ac7cead6-dde6-42ad-ad5c-9e066d4a09ef/init-textfile/0.log" Sep 19 01:54:22.775425 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.775376 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-7v5j2_ae16acff-f860-4441-8de9-5c5b6b3cd97d/kube-rbac-proxy-main/0.log" Sep 19 01:54:22.802509 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.802476 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-7v5j2_ae16acff-f860-4441-8de9-5c5b6b3cd97d/kube-rbac-proxy-self/0.log" Sep 19 01:54:22.835398 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:22.835369 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-7v5j2_ae16acff-f860-4441-8de9-5c5b6b3cd97d/openshift-state-metrics/0.log" Sep 19 01:54:23.175755 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.175685 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-579fff4bc7-jfs4h_d86b1a22-e16a-4495-b0ec-839c281c17af/telemeter-client/0.log" Sep 19 01:54:23.199233 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.199209 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-579fff4bc7-jfs4h_d86b1a22-e16a-4495-b0ec-839c281c17af/reload/0.log" Sep 19 01:54:23.223298 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.223282 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-579fff4bc7-jfs4h_d86b1a22-e16a-4495-b0ec-839c281c17af/kube-rbac-proxy/0.log" Sep 19 01:54:23.275859 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.275837 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7f4f666d-sk682_6e198d0e-fd1b-43e3-a37b-284a46640f3d/thanos-query/0.log" Sep 19 01:54:23.305255 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.305235 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7f4f666d-sk682_6e198d0e-fd1b-43e3-a37b-284a46640f3d/kube-rbac-proxy-web/0.log" Sep 19 01:54:23.342787 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.342769 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7f4f666d-sk682_6e198d0e-fd1b-43e3-a37b-284a46640f3d/kube-rbac-proxy/0.log" Sep 19 01:54:23.367183 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.367165 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7f4f666d-sk682_6e198d0e-fd1b-43e3-a37b-284a46640f3d/prom-label-proxy/0.log" Sep 19 01:54:23.394896 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.394873 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7f4f666d-sk682_6e198d0e-fd1b-43e3-a37b-284a46640f3d/kube-rbac-proxy-rules/0.log" Sep 19 01:54:23.421989 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:23.421965 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c7f4f666d-sk682_6e198d0e-fd1b-43e3-a37b-284a46640f3d/kube-rbac-proxy-metrics/0.log" Sep 19 01:54:24.681436 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.681401 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t"] Sep 19 01:54:24.681828 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.681813 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ceb82ae-7c8b-4ecc-a053-de8b8508ff06" containerName="manager" Sep 19 01:54:24.681880 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.681830 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ceb82ae-7c8b-4ecc-a053-de8b8508ff06" containerName="manager" Sep 19 01:54:24.681935 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.681902 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ceb82ae-7c8b-4ecc-a053-de8b8508ff06" containerName="manager" Sep 19 01:54:24.688447 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.688425 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.691152 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.691129 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pck\"/\"kube-root-ca.crt\"" Sep 19 01:54:24.691475 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.691452 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pck\"/\"openshift-service-ca.crt\"" Sep 19 01:54:24.692602 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.692561 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26pck\"/\"default-dockercfg-59ng7\"" Sep 19 01:54:24.694912 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.694891 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t"] Sep 19 01:54:24.812429 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.812399 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4ffn\" (UniqueName: \"kubernetes.io/projected/f7a5dfec-a529-442f-9c0b-d04916665b52-kube-api-access-v4ffn\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.812599 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.812444 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-lib-modules\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.812599 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.812462 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-podres\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.812599 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.812520 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-sys\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.812599 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.812538 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-proc\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913440 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913413 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4ffn\" (UniqueName: \"kubernetes.io/projected/f7a5dfec-a529-442f-9c0b-d04916665b52-kube-api-access-v4ffn\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913618 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913460 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-lib-modules\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913618 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913480 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-podres\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913618 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913516 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-sys\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913618 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913536 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-proc\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913761 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913652 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-proc\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913761 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913664 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-podres\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913761 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913652 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-sys\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.913761 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.913651 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7a5dfec-a529-442f-9c0b-d04916665b52-lib-modules\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:24.922913 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:24.922884 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4ffn\" (UniqueName: \"kubernetes.io/projected/f7a5dfec-a529-442f-9c0b-d04916665b52-kube-api-access-v4ffn\") pod \"perf-node-gather-daemonset-8n79t\" (UID: \"f7a5dfec-a529-442f-9c0b-d04916665b52\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:25.000100 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:25.000072 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:25.276888 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:25.276858 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t"] Sep 19 01:54:25.278161 ip-10-0-139-3 kubenswrapper[2587]: W0919 01:54:25.278136 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf7a5dfec_a529_442f_9c0b_d04916665b52.slice/crio-6684adc348a25ebe98e51f145f241f5f65f5f80f9b072a800922e5a3d15e246b WatchSource:0}: Error finding container 6684adc348a25ebe98e51f145f241f5f65f5f80f9b072a800922e5a3d15e246b: Status 404 returned error can't find the container with id 6684adc348a25ebe98e51f145f241f5f65f5f80f9b072a800922e5a3d15e246b Sep 19 01:54:25.757761 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:25.757725 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" event={"ID":"f7a5dfec-a529-442f-9c0b-d04916665b52","Type":"ContainerStarted","Data":"e67dfaed9ff20ad623661ffeeebf015d3fe9941f84ab232f5cb9da0dcdc10522"} Sep 19 01:54:25.758156 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:25.757823 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:25.758156 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:25.757851 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" event={"ID":"f7a5dfec-a529-442f-9c0b-d04916665b52","Type":"ContainerStarted","Data":"6684adc348a25ebe98e51f145f241f5f65f5f80f9b072a800922e5a3d15e246b"} Sep 19 01:54:25.775795 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:25.775752 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" podStartSLOduration=1.775737613 podStartE2EDuration="1.775737613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:54:25.774379553 +0000 UTC m=+905.507117809" watchObservedRunningTime="2026-09-19 01:54:25.775737613 +0000 UTC m=+905.508475865" Sep 19 01:54:25.806445 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:25.806422 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b596c78ff-85f24_de03c284-c195-4360-a9a0-0e9c7f6e37f4/console/0.log" Sep 19 01:54:26.454626 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:26.454591 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-j8dmg_e561de6a-b58a-4ee5-8fd1-60715cc0977d/volume-data-source-validator/0.log" Sep 19 01:54:27.619992 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:27.619966 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x5lhn_cfb4ddc3-53d0-4609-93d8-921c8355736c/dns/0.log" Sep 19 01:54:27.667357 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:27.667331 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x5lhn_cfb4ddc3-53d0-4609-93d8-921c8355736c/kube-rbac-proxy/0.log" Sep 19 01:54:27.783923 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:27.783891 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dvqqh_4934e60f-3b69-4fe2-b79a-1df00778d41e/dns-node-resolver/0.log" Sep 19 01:54:28.378687 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:28.378660 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c874474bc-tv2xj_ce2e8fc3-4c69-4ac4-90e8-c0281a4e3777/registry/0.log" Sep 19 01:54:28.453450 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:28.453422 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-npmxp_6d451716-6490-4ed9-9ad9-0cce3ad39280/node-ca/0.log" Sep 19 01:54:29.428620 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:29.428584 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss_6a574d35-bc3b-4e21-bc38-24b7ceb327d0/istio-proxy/0.log" Sep 19 01:54:29.481329 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:29.481302 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbbk2_d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9/discovery/0.log" Sep 19 01:54:29.566831 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:29.566806 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cb2cv_70822c2d-6dd9-4bdd-9728-d6b5ee555787/istio-proxy/1.log" Sep 19 01:54:29.567011 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:29.566998 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cb2cv_70822c2d-6dd9-4bdd-9728-d6b5ee555787/istio-proxy/0.log" Sep 19 01:54:29.642227 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:29.642205 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685cd8b794-rd4s4_560ad04e-389c-4f1b-8b47-0a93e69b04d8/router/0.log" Sep 19 01:54:30.353696 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:30.353659 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbfrx_30d4b3b9-0f41-498a-b012-6c68895e93c4/serve-healthcheck-canary/0.log" Sep 19 01:54:30.899731 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:30.899705 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhg94_b2708af3-3132-4ca6-9568-68ddc2f7220b/kube-rbac-proxy/0.log" Sep 19 01:54:30.927518 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:30.927497 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhg94_b2708af3-3132-4ca6-9568-68ddc2f7220b/exporter/0.log" Sep 19 01:54:30.961479 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:30.956689 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhg94_b2708af3-3132-4ca6-9568-68ddc2f7220b/extractor/0.log" Sep 19 01:54:31.773237 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:31.773212 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-8n79t" Sep 19 01:54:33.763474 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:33.763447 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-rvpsm_67c63f3a-dc27-44ac-a904-9e915e0feefe/manager/0.log" Sep 19 01:54:33.786442 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:33.786419 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-rvpsm_67c63f3a-dc27-44ac-a904-9e915e0feefe/copy-manifests/0.log" Sep 19 01:54:35.202988 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:35.202957 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fff7c5976-pz2hz_a8162ce1-1c70-4573-8279-b54f786244b3/manager/0.log" Sep 19 01:54:35.704344 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:35.704313 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss_6a574d35-bc3b-4e21-bc38-24b7ceb327d0/istio-proxy/0.log" Sep 19 01:54:35.743187 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:35.743165 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbbk2_d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9/discovery/0.log" Sep 19 01:54:35.798329 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:35.798288 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cb2cv_70822c2d-6dd9-4bdd-9728-d6b5ee555787/istio-proxy/1.log" Sep 19 01:54:35.798580 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:35.798551 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cb2cv_70822c2d-6dd9-4bdd-9728-d6b5ee555787/istio-proxy/0.log" Sep 19 01:54:35.849052 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:35.849029 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685cd8b794-rd4s4_560ad04e-389c-4f1b-8b47-0a93e69b04d8/router/0.log" Sep 19 01:54:36.968323 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:36.968299 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kr4ss_6a574d35-bc3b-4e21-bc38-24b7ceb327d0/istio-proxy/0.log" Sep 19 01:54:37.005522 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:37.005496 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbbk2_d2b9727e-2b8c-44ca-82a0-a3fad4cfb9d9/discovery/0.log" Sep 19 01:54:37.057447 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:37.057422 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cb2cv_70822c2d-6dd9-4bdd-9728-d6b5ee555787/istio-proxy/1.log" Sep 19 01:54:37.057791 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:37.057774 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cb2cv_70822c2d-6dd9-4bdd-9728-d6b5ee555787/istio-proxy/0.log" Sep 19 01:54:37.106637 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:37.106617 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685cd8b794-rd4s4_560ad04e-389c-4f1b-8b47-0a93e69b04d8/router/0.log" Sep 19 01:54:40.313163 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:40.313117 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-prx2z_c5644aba-5eb2-48d1-8e56-3dda8a12e0c4/migrator/0.log" Sep 19 01:54:40.336309 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:40.336244 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-prx2z_c5644aba-5eb2-48d1-8e56-3dda8a12e0c4/graceful-termination/0.log" Sep 19 01:54:41.864526 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:41.864469 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-67kn6_ee11f6c6-ee6b-44b2-9ee8-11ca32b8ac16/kube-multus/0.log" Sep 19 01:54:42.115871 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:42.115794 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkmc8_89e8356f-a36e-4dbd-85ab-f903e3fc245b/kube-multus-additional-cni-plugins/0.log" Sep 19 01:54:42.142182 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:42.142163 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkmc8_89e8356f-a36e-4dbd-85ab-f903e3fc245b/egress-router-binary-copy/0.log" Sep 19 01:54:42.167320 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:42.167298 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkmc8_89e8356f-a36e-4dbd-85ab-f903e3fc245b/cni-plugins/0.log" Sep 19 01:54:42.193287 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:42.193266 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkmc8_89e8356f-a36e-4dbd-85ab-f903e3fc245b/bond-cni-plugin/0.log" Sep 19 01:54:42.219901 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:42.219882 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkmc8_89e8356f-a36e-4dbd-85ab-f903e3fc245b/routeoverride-cni/0.log" Sep 19 01:54:42.245241 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:42.245221 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkmc8_89e8356f-a36e-4dbd-85ab-f903e3fc245b/whereabouts-cni-bincopy/0.log" Sep 19 01:54:42.271132 ip-10-0-139-3 kubenswrapper[2587]: I0919 01:54:42.271108 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkmc8_89e8356f-a36e-4dbd-85ab-f903e3fc245b/whereabouts-cni/0.log"